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mbTv^-5o ^MMlf^m(omm'r - ^ n s \t . y . cb (:f/u — (o^m) . Cr 

(U'-zKcOfell) <^ ^ Y C b C r 7=^- T 5> i: L T Ift §^ f ^ . R ( :/ K ) . G 

(i/y-V) . B (y/U — ) ;^^b.?'^5RGBx-^'^•CfcoTtJ:V^o *fc> YCbCr 
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lE»^®:U3tt. P^t«D4. DSfcS-tSV^T. «»«D7U-ixffir«D3-e«a$ix5«- 

®tgOii^7i< oSrlHlte$-y:ytt)MjttSHi:fc!3 UT®fiaPBlco-ftt?rdi^'i<-r^£)± 5 1- 

»^ia:U3f4. ®»PBTco-f*tSr'Je<i-J:e)Jc^ 1S^cD7u-AltaD3<D/>/i<tt-o 
®^J:!3t)iMA^v^*.ffi-e^^f5>. 30 
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r r -c. m — <Dyu — j^wn&.(D^\z.'^-<Dy)^—M,m^i>^th^t^\ IB — — a®^ 
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(u/2. v/2) MiiS-y:, (6/2) ISte^-ar.Stt'bJC. |g-07U--A®ifeSr ( 

-u/2.-v/2)afcii$^s (-«/2)lH)e$-frTtJ:V^, 
[ 0 0 4 2 ] 

ixrv^S. I^H^t'-i?^. >^V>'^2 0<Dthtim^%:h'yh-7hV^::^i^(D^§SL<omm 
■V^mm:m.i- ^ ^ — X' h ^ o :^m^Mm(Dm^7'— -fD 7 RGB#2 5 6Pgi§<73R 
G B f — ^ X i> i> t l^X m^-t i> i)i ^ YCbCrT*— i5'^-CS>o-CtJ:V''L, Pg^^Ct*! 
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(0^{t^ < fj: i> (OX X t) M m n (O ^ ± m n h ti ^ MK^^tf^TJ^j; *5 ^g:®K^S 

r i: tJS -c t 5 o 
[ 0 0 4 4 ] 

(3) mn^^^m(Dm : 
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-COSg«coffiJD5pi$j (gg^^ <^ * t i6 fcffl) ^co^^Tc7)BHi:THlSrllja5^^^*^ (-tc02 

f^M ^ ^ {z if ^ m X m ^ <Dis,m^ t ^ wi m ^ ^ -t i> y ^ — 

±^mW'r — i^^±^i-^iidim;b^^^mi:<ftt>rLi>^(Dyu-'M.mmt)^ 

[ 0 0 4 6 ] 

«)fclt;65B|fflTH3i^^T*fc^i<t!9/J^^:/^^)^T*>'U-i>.tt«Sra#1-5i:. JiIEM^t^ 
*5 . <t t) K M « i- 5 IS: ^ X ^ (5 if 58 fit T H 1 , T H 3 fi /J^ $ < ^ . BB,® T H 2 

$ixTV^-5o HSK^if «Srgg;?^m 13 ® ST K S W ffl (c S <5 T i* « ft « 5i # S 

yi^-j>^mm(oi^^s^m'ri>^t\cx^. m jitm ^ ^ m m x < n ^ z 1 7!>^ m t ^ o 

[ 0 0 4 7 ] 

(4) — v-aVOJi^: 
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m,^W.(OW}^ < s ^ ^ ^ ^^^^k L T V^ 5 t O t {S* L T v^ 5 o i" 

[ 0 0 4 8 1 

Ill7tc:s^"r<t5(c. — AtfSoMS (xi, yi) ^ ^ y \^ — J>^ m n (o mw. ( 

x2, y2) ^C*|-/^;LXV^-5^>(Oii-5o MilSJi (u, v) . |H]e»fi:7U-A®«fcC0 

. iHlteO^co^^Srtutt i: LT. M S O ^ i: b T ^ Sr 5 o . 

x2 = cos6*xl + sin6-yl — u •••(!) 
y2 = — sin6-xl + cos6-yl — v •••(2) 

/jr^b*. #fia:7U— — A]if«^irO^Fa^fir<fil;*^-Cfc5fc*. u. v. 

x2 = xl + 6- yl — u •••(3) 
y2 = ~6-xl + yl — v ... (4) 

1 0 0 4 9 1 

r;::-^. ia80±l&lC;^-r<t5l-x#R§:7U— ixtf^co^M^coSS^rzl (ix, iy 
) > St^7U-i^1t«<7)#®S<DjWSS:z2 (ix' . iy' ) ir^-Twtlci-^o Si* 
. ^^:7l^— i^lt^OJ^:^ (i x' . i y' ) ^ m y \y — ^ ^ <0 &m (i x'-'i x + 
1. iy'-iy+l)OFB^tcfe2>t>C04:Lr.^iB&tcJ:*?.Jffi^(ix'. iy*)S:* 

[ 0 0 5 0 1 

m(O^WL\C7r^^ ^ 0 \z. . mm (ix' , iy' )<Oxtt:*riR)(r5tt:fi$rix + Axi:U. P 

x = zl (ix+l. iy) - 2l (ix, iy) t i> t . Px-Ax=z2 (ix' 
, i y ' ) - 2 1 ( i X , i y ) i >i S i 5 A X Sr * ix « <t V> „ ^ SR (C H . # Sj ^ CI 
oV^T^xSr^ab. ^W-X^W-^^ t ^ ^ t \z.fj: ^ ^ rrt*. *t;i2 l = z l (ix, i 
y) . 2 2=2 2 (ix' , iy' ) X^:^ t . JWT<J0^365^9Sz:oJ:5?iAxS:»tU"r 

{Px-Ax - (z2-zl)}^ = 0 •••(5) 

*fc. m(OT WL\z.7T^'t i: b ^ M« (ix' , iy' ) OyW:&fp3<?5ffiMSriy + Ayi: 
Py = 2l (ix, iy + 1) - zl (ix, iy) ir-fSt. Py-Ay=z2 ( 

ix' , iy' ) - zl (ix. iy) i:7if5J:5/^Ay^*fej^^^J:V^o rr-Ct. ^ 
l;::zl = 2l (ix. iy). 22 = 22 (ix'. i y ' ) X t . \ikT (O^t^ ^ 
Vr. o<J:5^^Ay^^W1-i^^^iv^o 

{Py-Ay- (22-21)}^ =0 -"(e) 

^::T*. xyf^*'r^Sr#Ji:-t-'5i:. i^T(?:>^os^ Sr*/J^t-i-5Ax. AySrS/J-^«i£ 

= £{Px-Ax + Py-Ay - (22-2!)}^ -(7) 
[ 0 0 5 1 1 

4giBj£ J: !9 u-i.iiJ^fe;^)Sx»**'rpI^r.ytt*f^)^-2|I^T5»«b)^i: LTafeiiftSr* 
<D ¥^ ife Sr Uf. eg i- 5 o 



(13) 
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r = ( X ' + y M ' ' - ( 8 ) ■ 

0 = tan"^ (x/y) "' ( 9 ) 

[ 0 0 5 2 ] 

i^^ty'^x ia^ , >p)-*:7u-Aiii»-e**Ms (x, y) h d vx mm (x* , y* 

x'— X — r6sin0 = ~6*y •••(10) 

y'— y ^ r5cos0 = 5-x ••• (11) 

^wT*. ±ia^ (7) iC:foMt^Ax, A y it . Mittftu, v. lH]teS:6^ffiV>T. tJLT<30 

Ax = u — 6*y •••(12) 
Ay = V + 6-x •••(13) 

me>^±f5^ (7) tcftA-r^i:. i^Tc^5^;6M#biX'5o 

= Z{Px-(u-6-y) + Py-(v+6-x) - (z2-2l) 
) 2 ... ( 1 4 ) . 

[ 0 0 5 3 ] 

-r/.^t?'^. ^ m y \^ — m m (D mm ^ (i x, i y) tbr. #flS:7u-i^tt^o^iij^ 

[«c.l ] 

u = {(m^ •M02— iiiv u + (niu — -1111)0 v 

+ (mv -Mll-mu •M02)c 5) / d — (15) 

V = {(iDu -niv •Mll)cu + (in6 •M20— mu ^)cv 

+ (mu-Mll-mv-M20)c5}/d —(16) 

6 = {(fflv-Mll— mu-M02)cu + (mu-Mll— mv-M20)cv 

+ (M20 •M02 -Ml 1 ^)c 6 } / d - (17) 

tztz I. . i*t^Sf^SrlE:S»J-r^#-^Tfef9. a. 0, D, Nl-^-NS. M it T <D X ^ {Z 
U T * e> ix § „ 
[SC 2 ] 
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10 



20 



Pti = 22-zl —(18) 
ki = XiPYi — y iPXi —(19) 

M20 = SPxi^ -(20) 

1 

Mil = ZPxjPyi —(21) 

i 

M02 = SPyi^ ••(22) 

1 

mu = 2 k iPxi ••• (23) 

1 

mv = 2 k iPyi —(24) 

i . 

ma = S k -(25) 

1 

Cu = EPxiPti --(26) 

1 

Cv = ZPYiPti ••(27) 

1 

c« = X k iPt| —(28) 

1 

d = m5(M20-M02— Mll^) 

— (mu-M02— 2inu-niv*Mll+niv ^•M20) — (29) 

[ 0 0 5 4 ] 

tjioT, */j^a*&tcj: 9 — j^mmm<omm-rti t ^m-rtii:^tb i> -b is ^ ( i s ) 30 

~ (2 9) $-fflv>T. :t} M y ^ — 3 ic X 'O (u, v) i:lHltefi (6) Sr^g^ttiL 

o«IS:©7U-AflSf«*>€>iBSiii«o»ihiiilfeiSr#sr4:*Sojtgi:/jr5,. 
[ 0 0 5 5 ] 

. $ e> J: < Miifiif # t laHESItS i: S:Si#-r -5 r t , II M li « i SHE 

Srz2(ix,iy)i:«-rwi:lc:-r5. 

*-f^ #fi8 7U— Alf^Oiii^ (i X, i y) Sr*f^:7w- — jxtf^f^M^ (i x, i y) 
M rs^ ^ i> m mm t lt, mf^y ^ — ^«»Sr iiii^*ia:-rx:&iS]*fc«y:;6-(R]»c 

L = |Z2i-Zlil ■••(30) 

* , so 



( ,) 
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L=(Z2i-Zli)^ -(31) 
[ 0 0 5 6 ] 

y M.mm^<o^m&^^mmm& t 1.x (ax, Ay) tm-t::,t7b^xt^o 

-tw-C. »^:7l--^tf#lCOV>T^il^ (Ax, Ay) tz i^t M m -T b X is < t . ti 
1 0 0 5 7 ] 

(5) H<fe*^igg;6StT P *0.a : 
®^*^APLlCt*oT. PC10OCPU11;65;$:4[LS^^t5o IrIAPLJ^. PC±-e 

[ 0 0 5 8 ] 
) (5-1) -^j^fiSfflt^^J^mb: 

>^T>f/K^ielBtTKu;^S:«i-tf^^St#i-^(Sl0 5oJiUT. r>^'r!y:rjcot5«Sr 20 

:^^^1tai:LTRAMF^jC|5ti-r5 (SI 10) o 
[ 0 0 5 9 ] 

1 a-ct;i. 9cm(o y — M.mm\^m^\^^x y i^ — j^m^i: mTTi't ^ o m^iSim^m s i a 30 

^ U T . ih ^i?>8 1 c;65i7 y i/iJ^^i^Six^i:, M ft^i- i> li^l&T h*u^(Dy\y-J^m 
afc:S<5< :7 u — i..®«Sr*^-r?»o Z <D t ^ (D y u — i^Mlfe»^®S8 2 SrElo^&ffiSlc 
^ L T v^ 5 o 

[ 0 0 6 0 ] 

-tOiS^. Si 3tC^i-J:^7iv/— >'|R#^^®ffi(^^>rTn:^^;K:y^;^8 3Sr«*U> 40 

A;^^§:ttf^tt5 (SI 15) o y^Tx2i^^y^y^8 3X\t. ^^-r^Tzt^i^yu — 

t:iiMxmM-^m^im^mA:hms3h. c.^^^^s m^(omw^ 5 mmx^m-^m 
n?HM^-KA:^ffla8 3d.#axjft^>'8 3g. h m^ir ?> o mmi& & 7^ m S 3 h X 
itmmwm<Di^i^A:h^^i'fit^'fxw(Dm^^nL. mm^mA:^m s 3 c xnmmi^^ 

<:oSfef^A;^*^tt#itTHcDM^®i»*r^o ®®'=e-KA;tiffll8 3d-e(i. ittj^t^toms 

3 e t . •^'>^Sfef^{Cj:!9SS8 3 etC?&oT;^^-< K-5I8g7feISffl5o*^8 3 f Sr*:^"?-^ 
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mn^— h'^^mtx^xmi^i.. 2. 3. 4. 5*si#-r6. ho^j-cokjj?^'^' 

8 3 e V y ^J5£iii«<o®^^liw=i 2 8 0, H = 9 6 0 t ^ in . 

-5 „ 

M i& St <^ '0 i^iti^m'^mmi^ ^ ^ i:m^ ^ i> X 0 tcLTtjiv^. 
KSrK:^Wlgi:-t-6iiiSflp]±*v*Si#i-^) (s 1 2 0) . *3l3fe?i^«TMi, Eie-ca^L 

I 0 0 6 1 1 

Vli, £JIT«)SCT?^ $ nS. 20 
V=nl'(w-h)/(W-H) •••(32) 

ir^iS. r -C, «S5&-ipj©lt:*:J^S: S X , IrJ <D t£:^ ^ S: S y i: -r 5 i: , Sx=w/w 

V=nl/(Sx-Sy) •••(33) 
1 0 0 6 2 1 

JilESC (3 2 ) , (3 3) Sr^J^i-^t. eilT»5^;dS#btuS. 
nl=V«(W'H)/'(w'h) ••(34) 

nl=V'(Sx-Sy) — (35) 30 

-rSwi^s-etS. 'fc*5x S125T-«. ±fES; (3 4) Srffi^^T. 7^— -6>1S«(C*5»t 
-5iil*ro*g|^w • hi®Kl^]±SVi:lcS<5v^Tffil#-r57 u - a 1t^^ n 1 ^^fflf 5 
. ±ffiS; (3 4) , (3 5) ^rfflv^5rt^^:i•9, fSSS^iW^^i^^b, -e-fiKt-S^u-i^ 

f3ii5W®cD#Jtiii«^Sr#-5;ii:ds^fi6i:/i-5, -3^, lilflp|±«V;i)J/h$</jr5»iifJ;l9 
^m-t--5®»7'— ^'<£:^^i-«>^!a!SdSfTt>ix-5o tifoT. 1^ fti 3 Sr^ * ± < T » Jh iS 

1 0 0 6 3 1 

3 0) . »5:3£bfc7U'-Alt«^nl:S5S»T-JiV>i&^, nlSrE9jS5EAUfc!Pv 
«l/ilbT7l>-Alt^$r-^;5!cL, # Jt i® « # r i *5 W «g T 5 . 00 X. <i . :^®^<^|Sif 



C) 
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^ J5S: i" 5 o 

[ 0 0 6 4 ] 

(5-2) ^m-^ k ^^-^^(Dl^m : 

AOiaSrfT 5 ( S 1 3 5 ) o 

mi 4(1. ;«7;^ y ^ — iy B ly Vk-^ ^ y ^ — ^ ^ — htcj; ^9^UTV^5o 

If «Sri9:« LT J: v^o 

[ 0 0 6 5 ] 

(S2 10) o mpL\i^7hnm\^~^^(Dyu — M.^ni:M^yi^ — j>^mn\^wt^'t^^ 

iS^i-Sc ^wTt. — ^tf«i:1-S>'U-i.tfaS:RAMOcf(^m^o|M«(;i 

^ L T t i V^, 

[ 0 0 6 6 ] 

6i:^»ffi-r^±iss: (15) - (2 9) ^y^:^ ^ ^^mwc-s.-r 

S (S215) o m7L\i. ^?P<^^tfci-r^ 20, Mil, MO2, m^, m,. m 

-t<7)g&. # fiS :7 u — it« ^5 a a ® * i (^teS K ^ L . ^ ^y U - ^ nt^ h & U M 
Mi' offifiSrlS^-r^ (S2 20) o ^Jx.fi. :7u-i^t»^j55ei (x$i::&fR)) nxM^ 

.«(y«*-[p]) nymm(OVyh'^V})^:^ii^\Z.m^^fhX\f^7bm^.^my\y—-l>^'^ 
^Oj^^(ix, iy)Oiijm^aa®mt--r'5^tc:, i = ixH-nxXiyJCcJ:t)ae 
®*i60ffig«rK^-r5ri::ds-Ct5L.*r«>^u-Alf«OM:Sf(ix'. i y ' ) (O 

m^^^^'mm\z.'r^^\^. i' =ix' + nxxiy' <offiesrK 

:£-r5wi:^ST*#-5o ft B ® ^ <7) {4 g «r K ^ "t* ^ Ml J¥ « > &±(Dmmf)> 

**3> s2 2o<?:>«lll^^T9StJ^-. ±,^^ ^< ^ — > y ^ m \^ x ^ m y \y — m ^ 

b*j-^>'W"-A®^-^<;o:^^otf/j:afeitS (Ax. Ay) Ul L T Si # b . ^feiftS (A 

X, A y ) yi: «t®^Sr-r UT*5 V^T t» <t V^o 
[ 0 0 6 7 ] 

i' (DiUm^Wt'^'r ^ t . ±12^ (18) - (28) tCfflVN^Pti , ki 
, M20, Mil. M02. m^. m,. m^. c^. c,, c ^ ^m^^^-'t ^ (S2 

2 5) o «?0;ttf. M2 0(::ov^T^li^S3S^^a:ii-5i£:^M;^5fc'5fca^). m^M2 0(coi>T 
■* 

M20 ^ M20 + (aSS^i, i' (DZrtOflt) 
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-?rbT. # ra, :7 u - tt ^(O^® ^ o v^ T . ±f^^S^^^cov^Tm^ Ufc^=*S;^^S:^J 

[ 0 0 6 8 1 

S235-Ctt.±fBS;(29)Srffll^T. dSr»mi-5o 

lgfi\z,^ JilE^ (1 5) , (16) SrfflV>TM3iSu, v$:^J±lb (S240) . ±15^ ( 
17) SrfflV^TIH]tefi6Sr»ttl"r5 (S 2 4 5) o -T^it^-t,, :S»cD:7U-i>.1t«-C«a 

^ ®^PBl<D3feiii'tv^(Hi(s-ftb^^ -rat lis -^0^^7)5 iM^ct ^ t*Bi6^v^:*tSz:-cl^ 

S 2 5 0 ) o 
I 0 0 6 9 1 

•=t<0^.!fe:7U — -6.tf«tJloV>T. u. V. 6SrBt#Lfcd^5;!>^Sr*iJ»f'r^ (S 2 5 5) 

o u , V , 6 Si # b T v^ ;i v^ :7 u - t» ® ^ o T ^5 ^ . ^ ^ Ifli » ^ :7 u 

— AtfiaiSrK:^bT«fet)iSLS 2 0 5~S 2 5 5COAQi3SSrtfV>. A^t^(-OV^T 

&.±,<7:>^m:\^x . Misa (u. v) tiaites (6) sri^mb. z.f\.h^m.mm.mntmm 

-^mn t l.x^n^ ^ ^ t t^-r^ ^ ^ o -t<^^> :7 u — Ait « 0*^1^(0 fil:e^«l;65 

i: (Hi e fi It « b T t J: v> o 
[ 0 0 7 0 ] 

(5-3) AStf^O-fixttiE: 

^-r. igi4<os2ioi:iii3m*-bT. M^yi^ — j>^^Wi(o^t^h. mm (ommir^^-t 

-5*I'*:7U — i>.tfSSrK;ti-5 (S 3 0 5) o JJcJ-^ iai4<DS 2 2 0i:l^1^tcLT\ » 
^:7ix-i^'|tffl*^e>M«^lfe1-5aiiii^i' co{fl:«Sri2^i-5 (S3 10) » 
I 0 0 7 1 1 

(S315) o 'tti:t>ib. mm (ix', i y ' ) (D&smm i ' <oiiLmit> & 

«(ix*-u, iy*-v)(C^tT^iij$itbH5or^T*.M^(ix'-u, iy 

ffi ;S 3^ ^ -r 5 ( S 3 2 0 ) o r r . mm ( l x ' - u , i y • - V ) ?r . ^ 'iL> 

t'ri>mm (xV. y' ) t;i«#»;t. I^Mt^hmm (x' . y* ) 4-C<^Sg«Srr' i: 
-rst. (x* , y* ) \t-5<D\B]m\Z.X^xm:fjl^\:^-d • y. ' . yW^T^tCfi • 

X ' i^id-r So *:>-^. Mii^coM:^ (ix' - u. iy' - v)<;oae®j^i' <o<fi: 

:7U — i^1t«co®^J:'9t*ffl;5^<$ixfcM« (x' -6 • y* , y' + 5 • x' ) 
[ 0 0 7 2 ] 



* 
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*ffe7U-Atfao^iij^(c:oVNT. mm^^^Vr ^tLt^'^t^^nWi'T ^ (S3 

'^tJit^hWk^MX.S 3 0 5-8 3 2. 50«laSr^TV^, S ^ o V^ T ffi «i ^ Jfe o fc *i 
-g^ (C . S 3 3 0 3i o 

#S:iaSb-C«lt)3gUS 3 0 5 — 8 3 3 0(?5*Q^aS:^TV^. ±*tft:7lx-i>.1f#(coU>Tffi 
I 0 0 7 3 1 

(5-4) WfttT^'g^^ : 

Sr a -fr 5 *Q; a 5 o 

[ 0 0 7 4 ] 
[ 0 0 7 5 1 

05) o ^m^mmi&xYx. m \ a <d s 2 2 o kmm\^\^x»±m^\^^(i:>-t ^^nmm i 

#«E-r^®^i:l^aBM^ii:cD]ieg6S:»tti-r^ (84 10) « aeS^ilcSfc 

i£v>S^®^?r3Sttii-5 (8 4 1 5) o aaic7:>^lcf^. mx.\^^ *MM^coM^fiI^RA 

<^M^S: (xO, yO) . aiH^i<^3fi<^(c#fe-r^ii)^OM^Sr (xf, yf) t -t 
i> t . {(xf-xO)^+(yf-yO)M''^^2!|5a/J^^:7i^,«^Sr»^^i^^i:1- 
^^^^J:v^o 40 

1 0 0 7 6 ] 

«x-^oiiF* (jBE«li. 5^fiF«B) ffi fi t> n h s T v> 5 , r r . # :7 u - it 

«t-:7l^-A#-§-f (f = l, 2. 3. 4) Sr^-^-rSt^tJC. ^y^U-AttacO-ttt 
tcogggt^. L (i, f) ■CSbTV^;5o ^LT> L (i, f) :6^*t/h$<^<t^fne 

a r e s t (i) ^**5o :l<^ffl;^|S/J^^cv^jl^^Tfc5^^if (SUi$*xfcS^dsas®^ 
±m ^ ^ <o y nii^ <D -J ^ ^ — < * S « fpj J:: fc S o la O a a B ^ i o V^ T . 50 
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L ( i . 4 ) * /JMt i: 5 fc . :7 u — ix 4 O Si ^ S ffi * S o 

-tcD^. ag®^i:6^?>&M®^*T-cO£6gSMinL (i, f) ^^nV (S420) . 

aM®^$r'g'tf:7U-Atff8Sr®#-rs (S 4 25 )o Elofi^J-CJi. y u — 4 (D y u — 

I 0 0 7 7 1 

t^'^ri^^-r^ (S 4 3 0) o -tO^. YCbC r'f — ^(D't^mi^r'—^^±^ 10 

y"- ^ CO it ^ ^ as -ft: L T v> t . ^<D^itti^mm<Dmm<Dfismy''-i?tcifii^^^ 

-r ^ — JSfe B8»c i: ixT -5 , . r ;i -e. U v^ a S M * i Sr » 9 ffl tf ES o <3D M * 6 l a ~ 

d X mm ^ in ^ ^ mm i X m-o (Ds,mic^m . 't(DmmitxMmiLm(o 

y" — ^ KM tt ix v^ o 20 

^t^S$tLfc®«^7='-^$^co#®^{cov^T. l^^ociirSrtTxJi. -T T iS ^ fit i" 

S r i: # ^ o . 
[ 0 0 7 8 1 

mm i oM^r"— ^$'i:i-^^^^J:v^o m y< • ^ ^ — fc o J: 5 ffi g <fc 30 

^ r y< ^ . .:^f ^ - t:* ^/ ^ & J . r . y - T & J \ r n r y h ^ — m j 

v>-rixd^^s«^A;ti^«gi: LTfet. mvi X t» ^ tiitmm mm\z X ^ msmm(Dmi£iy'- .-x 

I 0 0 7 9 1 

t<D^. — Sr^JK"^S:^Hm^coV^T. Pal AQf 31 *c J: !9 ® « x - ^ Sr * b 

S^;!)^S:*iJ^-r5 (S4 3 5) o ® ^ x - ^ ^ L T V^ l^ ® ^ ^ o T V> 5 . 

*^-r4®*fe7^-i5^tc*t/S;-r-^.®^±-cag®^ i S:]iH^fc^Si$^n^;d5e>i^9iSbS 4 0 
S'-S 4 3 5 (O idimi: n 0 o ±m m {:i <> X m — ^ ± ^ tz m ^ it . :^y ^ — ^ 40 

V? ^ :¥ - A < S a ;^ b iL ^ o r J: 5 . * i :7 u - ^ ^ o tt 
««ffi®«Sr#Sri:d5pJili:/jr-5o 50 
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[ 0 0 8 0 ] 

m S 4 a lC|^ii:®^Sr*:5^-r^i: i: h \Z , y r ^ ^ Kti m S 4 b. 7K^5^>'8 4 c, 

dfcS^-rSo ft#:7T-f>'^*A:t?«08 4 b(cT«#i-5:7r-f/^*^olftf^A:^;SrStt# 
(t. O K -Tfs ^ :y s A c ^ ^) y ^ i ^ t . m,h\zAti^ihtz:7r^^i^^ TM-tey^- 
^?SrHD^jc(IS:#U (SI 5 5) . *:7D-S:jS^T-r5o roj;5(-UT. ^ - if ;d5 1^ ^ 

[ 0 0 8 1 ] 

m ^j: ^ \i ^ ^-r ^ y i^-^t»«^o&ii/>/j:< ^x»jtm^(o±^mm^ u± ^^^^ 

:^^m.mm'SEi' ^ ^ t tj: < . ^-r ^ y - ^ t*^ ^ m \c y ^ ^ :^ Ji- l^c ^ ;^ ti ^ ^ ^ 

o 

[ 0 0 8 2 ] 

( 6 ) m^<Dmm.mm 

<c*3, m 17 x^ I. it mm (o^xsc mm ^ -MX (o^mM i n L (i, f) srS^fflbT 

TV^5c**J6?^SiTMl. :7lx — AKlW^^tC J;|9 5 5 0 5 — 3 5 2 0, S 5 4 0~S5 
50cO*fl;g;dS^Ti?jxSo 

lll^$'^''BSLTv^^;^l5^ mi 1 (D s 1 0 5--S 1 1 0 t mm^ r ^ ^^^i^^-r 

. MS^ — K^^MS:Si#-r'5 (S 5 0 5) „ l2l6t?^L]t*|-iS;7" — :/>'WS:#fi8U 

T®«^-KK^ffi{c^/^;-r5SiffiTHl (MKSi^tf^) Sr^Wi-^ (S5 10) » r 

V^li^^*■CC08EStMinL (i, f) <DW'^\Z^\,'^X (Dmm,X h ^ . 
[ 0 0 8 3 ] 
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0) . i^ — j^-^n^^'^-f- i> t . m 1 4 x'tt: Ltc:;it} 7 ^ — i^ a :^m-&^mi:n^^ 

2 5) . u, V, 5SrSJ#-r5)i:, lal 5-t?5^Lfc7U-A^^^0.SSr^T^^, M^yi^ — 
A it « oifelij*tc:ov>T#fl87U-Atf«i:<o-fixSr/jr<-t-J; 5 tcgl^S^glSrtTP (S 5 

3 0) o — A^^ft,^Q.3a^^T5i:s iai7T-:^bfc-a-fi£«!!a (-eoi) srtT^^, ^^i- 

M « ^ — ^'©#WS^{c:ov^TMi nL (i. f) i:nm-t^ttii\z. ^M^i^-AlS 

3 5), 

[ 0 0 8 4 ) 10 
-t©^, 7 ^-A^fa(7)f^#S^i|ilTi-5@f:t©J^T^^**>fiKSE■f-^>*»^*»*5|£lJWr•t-5^«> 
Oi¥ffifitVlSr»aii-5 (S540) „ fFffiffiVlJ*, £ATO^t?S^tl-^)±5t-, Mi 

nL (i, f) (Dmfai:^^^(Dm^y'-^i'<Dmm^w-Ht^^Litm.. -r^iip-^x mi 

nL (i, f) (OW-^MX'Sy^o 

Vl={2MinL(i. f))/(W-H) -(36) 

^LT. VliiSTHlWT (Bff^cO^T^ft) Xh ^ A^SrflJK^-T^) (S 545) „ V 

1 *STH 1 i *3 /J^-Cfc-6*»5*»S:*lJt5r-r5 ± 5 LTfc±V^. V 1 ;dSTH 1 J: t) ($fc (^) 

»4W-t) -efc-5t^««-T^#fifeS:i:LTS 5 5 0lrift;^^. Vl;iSTHltiT-Cfc-5tf:S 

5 5 SJdiitf. S 5 5 0t?*i, Bff^»5fi*!l*l-T^fe# («ajx.lix Ell SCO^SOi^T^iH^VS 

3 i 2)5^ U 5/^'Sfef^$ttytl^ffi) :iS^S!:bTV>S*»5*>SrfljerL. S 5 5 5 20 

AW«i:U-C^»UTiefei3)gLS 5 2 0~S 5 4 5ro«lS%ff. 5o i-'tCi3*>. 

bliRJ3c7u-.^1tSlSrKi»L/.c;ei5t.. fi£ i" 5 iii « - ic *j tt S # ® ^ o v> T , Si# 

U^«»07 .AifacDMlgro 5 *>}iB®^d»P>SSa®^4t?<D8E(ltM i n L ( i . 
f.) ^^ttSU, Mi nL (i. f) <D W-i^ m t M m T H 1 t i:: & X m (D ^ T 0i ^ 

fiS:a:-r«>*='5*»%*j»fL, m iK^ T 0i i)^ ^ -f- i> tmvsil^ti i: w-AWSw^^Sr 

iiil-T-rSriJ-neSc -^rO^^. P'U' — Att^^Sli*PU-C*M®^*T-<OlggSMinL ( 
i. f) OSp-*afiti6Sg|^THlKAT*T-/h$<JfcS*-e. 7 U — A If « # f 5 S *5 
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CLAIMS 

[Claim(s)] 
[Claim 1] 

It is image generation equipment which generates the image data which acquires two or 
more &ame information from the image information which has much frame information 
which expressed the image by the gradation data according to many pixels, compounds two 
or more frame information concerned, and carries out the gradation expression of the 
output image of an image output unit by many pixels, 

A frame acquisition means to determine the number of the frame information which 
acquires the image quaUty of the above-mentioned output image from the above-mentioned 
image information based on the image quaUty setting information whose setup is enabled, 
and to acquire a number of the determined above-mentioned frame information from the 
above-mentioned image information. 

Image generation equipment characterized by providing a synthetic means to compound 
an acquired number of the above-mentioned frame information, and to generate the 
above-mentioned image data. 
[Claim 2] 

An amount acquisition means of gaps to acquire the gap information which expresses the 
gap between the images expressed for the frame information on this plurahty based on two 
or more above-mentioned frame information, 

A conversion means to perform transform processing which changes at least one of the 
frame information on this plurality so that at least one of each of the image expressed for 
two or more above-mentioned frame information may be moved based on the acquired 
above-mentioned gap information and the gap between images may be lessened is 
established, 

The above-mentioned synthetic means is image generation equipment according to claim 1 
characterized by compounding two or more frame information that the above-mentioned 
transform processing was performed, and generating the above-mentioned image data. 
[Claim 3] 

The above-mentioned frame acquisition means is image generation equipment given in 
either claim 1 characterized by increasing the number of the above-mentioned frame 
information which carries out acquisition, so that the above-mentioned image quality 
setting information is the information which expresses high definition more, or claim 2. 
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[Claim 4] 

The above'mentioned frame acquisition means is image generation equipment according to 
claim 1 to 3 which determines the number of the above-mentioned frame information 
which carries out acquisition, and is characterized by acquiring a number of the 
determined above'mentioned frame information from the above'mentioned image 
information based on the total of a pixel and the above-mentioned image quaUty setting 
information in the above-mentioned frame information. 
[Claims] 

It is image generation equipment according to claim 4 above'mentioned image-quality 
setting information is made; into the multipUer by which the ratio of the total of the pixel in 
the above-mentioned frame information over the total of the pixel in the above-mentioned 
image data multiplies, and carry out the above-mentioned frame acquisition means 
calculating the value which multiplied the above-mentioned ratio by this multiplier, 
determining the number of the above-mentioned frame information which carries out 
acquisition so that abbrevia:tion coincidence may carry out with the value concerned, and 
acquiring a number of the above-mentioned frame information which determined from the 
above-mentioned image information as the description. 
[Claim 6] 

The above-mentioned frame acquisition means, acquiring the sequential above-mentioned 
frame information from the above-mentioned imiage information The distance to the 
nearest pixel is computed among the pixels of two or more frame information said-acquired 
about each pixel in the above-mentioned image data. It judges whether the predetermined 
terminating condition which ends acquisition of frame information based on the value and 
the above-mentioned image quality setting information that the computed distance was 
summarized is satisfied. Image generation equipment according to claim 1 to 5 
characterized by ending acquisition of the above-mentioned frame information when it 
judges that this terminating condition is satisfied. 
[Claim?] 

It is image generation equipment according to claim 6 with which the value which 
summarized the distance in which the above-mentioned frame acquisition means carried 
out [ above-mentioned ] calculation is characterized by below this threshold or to acquire 
the above-mentioned frame information from the above'mentioned image information 
until it becomes smallness more by being made the above-mentioned image-quality setting 
information into the threshold about the value which summarized the distance to the 
nearest pixel among the pixels of two or more above-mentioned frame information about 
each pixel in the above-mentioned image data. 
[Claims] 

The above-mentioned frame acquisition means, acquiring the sequential above-mentioned 
frame information from the above-mentioned image information It asks for the number of 
the frame information which has the pixel which becomes predetermined within the limits 
about each pixel in the above-mentioned image data. It judges whether the predetermined 
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terminating condition which ends acquisition of frame information based on the value and 
the above'mentioned image quality setting information that the number for which it asked 
was packed is satisfied. Image generation equipment according to claim 1 to 7 
characterized by ending acquisition of the above-mentioned fi*ame information when it 
judges that this terminating condition is satisfied. 
[Claim 9] 

The above-mentioned image-quaUty setting information is made into the threshold about 
the value which packed the number of the firame information which has the pixel which 
becomes predetermined within the limits about each pixel in the above-mentioned image 
data, and the above-mentioned firame acquisition means is image generation equipment 
according to claim 8 with which the value which packed the number for which it asked is 
characterized by beyond this threshold or to acquire the above-mentioned frame 
information firom the above-mentioned image information until it becomes size more the 
account of a top. 
[Claim 10] 

The above-mentioned firame acquisition means, acquiring the sequential above-mentioned 
firame information fi'om the above-mentioned image information It asks for the number of 
pixels with which the number of the pixels of the above-mentioned fi-ame information 
which becomes predetermined within the limits among the pixels in the above-mentioned 
image data becomes below a predetermined number. Image generation equipment 
according to claim 1 to 9 characterized by ending acquisition of the above-mentioned firame 
information when it judges whether the predetermined terminating condition which ends 
acquisition of firame information based on the number and the above -mentioned image 
quality setting information which were searched for is satisfied and judges that this 
terminating condition is satisfied. 
[Claim 11] 

It is image generation equipment according to claim 10 with which the ratio which the 
above-mentioned firame acquisition means asked for the above-mentioned ratio, and asked 
is characterized by below this threshold or to acquire the above-mentioned firame 
information firom the above-mentioned image information until it becomes smallness more 
by being made the above-mentioned image-quahty setting information into the threshold 
about a number of a pixel of ratios with which the number of the piixels of the 
above-mentioned firame information which becomes predetermined within the limits 
among the pixels in this image data to the total of the pixel of the above-mentioned image 
data becomes below a predetermined number. 
[Claim 12] 

The above-mentioned firame acquisition means is image generation equipment according to 
claim 1 to 11 characterized by to determine the number of the firame information which 
receives the input of the information which a£fects the image quaUty of the 
above -mentioned output image, acquires the above-mentioned image-quality setting 
information, and acquires it firom the above-mentioned image information based on the 
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acquired image -quality setting information based on the inputted information. 
[Claim 13] 

It is the image generation method which generates the image data which acquires two or 
more &ame information from the image information which has much frame information 
which expressed the image by the gradation data according to many pixels, compounds two 
or more frame information concerned, and carries out the gradation expression of the 
output image of an image output unit by many pixels, 

The frame acquisition process which determines the number of the frame information 
which acquires the image quality of the above-mentioned output image from the 
above-mentioned image information based on the image quality setting information whose 
setup is enabled, and acquires a number of the determined above-mentioned frame 
information from the above-mentioned image information. 

The image generation method characterized by providing the synthetic process which 
compounds an acquired number of the above-mentioned frame information, and generates 
the above-mentioned image data. 
[Claim 14] 

It is the image generator which makes a computer realize the function which generates the 
image data which acquires two or more frame information from the image information 
which has much frame information which expressed the image by the gradation data 
according to many pixels, compounds two or more frame information concerned, and 
carries out the gradation expression of the output image of an image output unit by many 
pixels. 

The frame acquisition function which determines the number of the frame information 
which acquires the image quality of the above-mentioned output image from the 
above-mentioned image information based on the image quality setting information whose 
setup is enabled, and acquires a number of the determined above-mentioned frame 
information from the above-mentioned image information. 

The image generator characterized by realizing the synthetic function which compounds 
an acquired number of the above-mentioned frame information, and generates the 
above-mentioned image data. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the image generation equipment, image generation method, and 
image generator which generate image data from the image information which consists of 
much frame information. . 
[0002] 
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[Description of the Prior Art] 

Conventionally, the image data showing a static image is generated from the image 
information showing the image photoed by the digital video etc., and printing a static 
image based on this image data is performed. Image information consists of frame 
information on a large number which expressed the image by the gradation data according 
to many pixels, and the image data which carries out the gradation expression of the static 
image by many pixels is generated by acquiring and compounding the frame information 
on a predetermined number from this image information. Since blurring may have arisen 
on the image photoed by the digital video etc., a gap of the longitudinal direction and 
lengthwise direction between the images expressed for two or more frame information is 
detected per pixel, a longitudinal direction is made to carry out Ny pixel (for Nx and Ny to 
be positive integer) advancing side by side (parallel displacement) of the image piled up to 
the image made into criteria to Nx pixel and a lengthwise direction, and a gap of a 
lengthwise direction and a longitudinal direction is lessened. 

Moreover, the memory for the images of high resolution is prepared for the patent 
reference 1 in the case of the resolution conversion in the image of high resolution of 
standard resolution from an image, a motion of an image is detected, and it is indicated 
that each pixel of the image of high resolution is fill uped with the pixel of the image of two 
or more standard resolution which carried out the parallel displacement according to the 
motion of an image. The processing which buries each pixel of an image is repeated until it 
is judged with there having been a scene change or is judged with the input of a distortion 
image (image of standard resolution) having been completed in that case, as it is in the 
paragraph 0089 of this patent reference 1. 
[0003] 

[Patent reference l] 

JP.11-164264,A 

[0004] 

[Problem(s) to be Solved by the Invention] 

The following technical problems occurred in the Prior art mentioned above. 
With the former technique, since the frame information number to compound was being 
fixed, the processing time which generates image data to the image quality searched for 
beyond the need might start. 

With the latter technique, since frame information will be compounded until there is a 
scene change or the input of frame information is completed, the processing time which 
generates image data to the image quality searched for too beyond the need will start. 
[0005] 

This invention was made in view of the above-mentioned technical problem, and aims at 
offer of the image generation equipment which processing which generates the image data 
expressing a static image is performed efficiently, and can obtain a static image efficiently, 
an image generation method, and an image generator. 
[0006] 
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[The means for solving a technical problem and an efifect of the invention] 
In order to attain the above-mentioned purpose, in invention concerning claim 1, the 
number of the firame information acquired from the image information which has much 
frame information is determined based on the image quality setting information whose 
setup of the image quaUty of the output image of an image output unit a frame acquisition 
means enables first. In addition, let each frame information be the information which 
expressed the image by the gradation data according to many pixels. And a number of 
determined frame information is acquired from image information. Then, a synthetic 
means compounds a number of frame information acquired with the frame acquisition 
means, and generates image data. 
[0007] 

That is, since it becomes possible to compound a suitable number suitable for the image 
quality of an output image of frame information, and to generate image data, it becomes 
possible to perform efficiently processing which generates the image data expressing a 
static image, and to obtain a static image efficiently. For example, what is necessary is for 
what is necessary to be just to compound the frame information on comparatively many 
numbers to obtain a high-definition output image, and just to compound a comparatively 
small number of frame information to obtain an output image quickly. In such a case, it 
becomes possible to obtain the static image of target image quaUty by the shortest 
processing time. 
[0008] 

The above-mentioned image output unit can consider various equipments, such as a 

printer which prints by inputting image data, and a display outputted by display. 

The format of the above-mentioned image quahty setting information can consider various 

formats, such as numerical information and text. 

[0009] 

An amount acquisition means of gaps to acquire the gap information showing the gap 
between the images expressed for the frame information on this plurality here based on 
two or more above-mentioned frame information, A conversion means to perform 
transform processing which changes at least one of the frame information on this pluraUty 
so that at least one of each of the image expressed for two or more above-mentioned frame 
information may be moved based on the acquired above-mentioned gap information and 
the gap between images may be lessened is estabUshed. The above-mentioned synthetic 
means It is good also as a configuration which compounds two or more frame information 
that the above-mentioned transform processing was performed, and generates the 
above-mentioned image diata. 
[0010] 

Namely, by lessening the gap between two or more images with which the image data 
which carries out the gradation expression of the image is expressed for two or more frame 
information^ since it is compounded from the frame information on this plurality and is 
generated, blurring is amended. Therefore, it becomes possible to obtain a high-definition 
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static image from two or more frame information on image information. 
[00 111 

The above-mentioned frame information and image data can consider the information on 
various data format, such as for example, bit map data and compressed data. This frame 
information and image data Moreover, for example, the YCbCr data which consist of 
brightness data (Y) and color difference data (Cb, Cr), The RGB data which consist of red 
data (R), Green data (G), and blue data (B), The data of various classes, such as CMYeG 
data which consist of cyanogen data (C), Magenta data (M), yellow data (Ye), and Green 
data (G), and Lab data in the Lab space made into CIE specification, can be considered. 
[0012] 

The above-mentioned amount acquisition means of gaps acquires the rotation information 
showing the rotation gap between the images expressed for the frame information on this 
plurality based on two or more above-mentioned frame information. The above-mentioned 
conversion means Transform processing which changes at least one of the frame 
information on this plurahty so that at least one of each of the image expressed for two or 
more above-mentioned frame information may be rotated based on the rotation 
information by which acquisition was carried out [ above-mentioned ] and the rotation gap 
between images may be lessened may be performed. 
[0013] 

The above-mentioned amount acquisition means of gaps acquires the amount information 
of advancing side by side that the advancing-side-byside gap between the images 
expressed for the frame information on this plurahty is expressed, based on two or more 
above-mentioned frame information. Moreover, the above-mentioned conversion means It 
is good also as a configuration which performs transform processing which changes at least 
one of the frame information on this plurality so that at least one of each of the image 
expressed for two or more above-mentioned frame information may be made to advance 
side by side based on the amount information of advancing side by side by which 
acquisition was carried out [ above-mentioned ] and the advancing-side-byside gap 
between images may be lessened. 
[0014] 

That is, frame information is compounded and a static image is generated so that the 
rotation gap and advancing-side-by-side gap (gap in every direction) between frame 
information may be lessened. Moreover, the inclination component of blurring is more 
certainly amended by lessening the advancing-side-byside gap of a predetermined center 
position which rotates an image. Therefore, it becomes possible to obtain a fiirther 
high-definition static image. 

The above-mentioned rotation information and the amount information of advancing side 
by side can consider various information, such as numerical information and text. 
[0015] 

As an example of the above-mentioned transform processing, the above-mentioned 
conversion means may perform transform processing which changes the location of each at 
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least one pixel of two or more above*mentioned frame information so that a gap of both the 
above'mentioned images may be lessened based on the above-mentioned rotation 
information and the amount information of advancing side by side. A conversion means 
may change the location of each at least one pixel of two or more frame information in a 
unit finer than the pixel concerned in that case. Since location conversion (coordinate 
transformation) of each pixel of frame information can be performed with high degree of 
accuracy, it becomes possible to obtain a further high-definition static image. 
[0016] 

The above-mentioned frame acquisition means is so good that the above-mentioned image 
quality setting information is the information which expresses high definition more also as 
a configuration which increases the number of the above-mentioned frame information 
which carries out acquisition. The number of the frame information compounded, so that 
image quality setting information turns into information which means high definition 
more increases, and it becomes possible to obtain a higher-definition static image. Since 
the number of the frame information compounded on the other hand, so that image quality 
setting information turns into information which means low image quality more decreases, 
processing which generates image data more at high speed is performed. Therefore, it 
becomes possible to perform processing which generates the image data which expresses a 
static image efiSciently, and to obtain a static image. 
[0017] 

Here, the above-mentioned frame acquisition means determines the number of the 
above-mentioned frame information which carries out acquisition based on the total of a 
pixel and the above-mentioned image quaUty setting information in the above-mentioned 
frame information, and is good also as a configuration which acquires a number of the 
determined above-mentioned frame information from the above-mentioned image 
information. Processing which generates image, data ef&ciently with the simple 
configuration of determining the number of the frame information compounded based on 
the number of pixels can be performed. 
[0018] 

Since a static image is made more into high definition so that there are many pixels of the 
frame information compounded in invention which starts claim 5 as the example, a 
suitable number of frame information which more certainly suited the image quality of an 
output image can be compounded, image data can be generated, and it becomes possible to 
perform efficiently processing which generates image data more certainly. 
[0019] 

Moreover, the above-mentioned frame acquisition means, acquiring the sequential 
above-mentioned frame information from the above-mentioned image information The 
distance to the nearest pixel is computed among the pixels of two or more frame 
information said-acquired about each pixel in the above-mentioned image data. When it 
judges whether the predetermined terminating condition which ends acquisition of frame 
information based on the value and the above-mentioned image quality setting 



8/45 



Japanese Publication number : 2004-229004A 



information that the computed distance was summarized is satisfied and judges that this 
terminating condition is satisfied, it is good also as a configuration which ends acquisition 
of the above-mentioned fi'ame information. Since a static image is made more into high 
definition so that it is close to the pixel of the image data after the pixel of firame 
information generating, a suitable number of fi-ame information which certainly suited the 
image quality of an output image can be compounded, image data can be generated, and it 
becomes possible to perform efficiently processing which generates image data. 
[0020] 

The values which summarized the computed distance are various idea ****, such as the 
arithmetical mean, the geometrical mean, the harmonic mean (inverse number of the 
arithmetical mean of the inverse number of the computed distance), an average that 
attached weight which is different in each computed distance, and total. Hereafter, the 
same thing can be said also when packing two or more numbers. As the example, invention 
concerning claim 7 enables it to perform efficiently processing which generates image data 
certainly with a simple configuration. 
[0021] 

Furthermore, the above-mentioned firame acquisition means, acquiring the sequential 
above-mentioned frame information firom the above-mentioned image information It asks 
for the number of the firame information which has the pixel which becomes predetermined 
within the Umits about each pixel in the above-mentioned image data. When it judges 
whether the predetermined terminating condition which ends acquisition of firame 
information based on the value and the above-mentioned image quality setting 
information that the number for which it asked was packed is satisfied and judges that 
this terminating condition is satisfied, it is good also as a configuration which ends 
acquisition of the above-mentioned fi'ame information. 
[0022] 

Since a static image is made more into high definition so that it is close to the pixel of the 
image data after the pixel of fi-ame information generating, a suitable number of firame 
information which certainly suited the image quality of an output image can be 
compounded, image data can be generated, and it becomes possible to perform efficiently 
processing which generates image data. As the example, invention concerning claim 9 
enables it to perform efficiently processing which generates image data certainly with a 
simple configuration. 
[0023] 

Furthermore, the above-mentioned firame acquisition means, acquiring the sequential 
above-mentioned firame information fi*om the above-mentioned image information It asks 
for the number of pixels with which the number of the pixels of the above-mentioned firame 
information which becomes predetermined within the limits among the pixels in the 
above-mentioned image data becomes below a predetermined number. When it judges 
whether the predetermined terminating condition which ends acquisition of firame 
information based on the number and the above-mentioned image quahty setting 
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information which were searched for is satisfied and judges that this terminating condition 
is satisfied, it is good also as a configuration which ends acquisition of the above-mentioned 
firame information. 
[0024] 

Since a static image is made more into high definition so that it is close to the pixel of the 
image data after the pixel of frame information generating, a suitable number of fi'ame 
information which more certainly suited the image quality of an output image can be 
compounded, image data can be generated, and it becomes possible to perform efficiently 
processing which generates image data. As the example, invention concerning claim 1 1 
enables it to perform efficiently processing which generates image data certainly with a 
simple configuration. 
[0025] 

By the way, the above-mentioned fi'ame acquisition means is good also as a configuration 
which determines the number of the firame information which receives the input of the 
information which affects the image quality of the above-mentioned output image, acquires 
the above-mentioned image-quality setting information, and acquires it from the 
above-mentioned image information based on the acquired image-quaUty setting 
information based on the inputted information. Since the number of the firame information 
compounded by inputting information which affects image quality is determined 
automatically and image quahty can be set up, convenience improves and it becomes 
possible to obtain a more satisfEictory static image. 

The information which affects the image quahty of an output image can consider various 
information, such as the set point corresponding to the location of the accommodation 
tongue which sets up image quahty and processing speed sensuously and which can be slid, 
resolution, and the number of pixels. 
[0026] 

The above-mentioned synthetic means is good also as a configuration which performs 
predetermined interpolation processing using the gradation data of the pixel which exists 
around this attention pixel among all the pixels of two or more above-mentioned firame 
information, and generates the above-mentioned image data firom the gradation data after 
interpolation processing, carrying out sequential migration of the attention pixel which 
generates the above-mentioned image data. Since the image data of each pixel is 
interpolated by the gradation data of the pixel which exists on the outskirts and is 
generated, it becomes possible to obtain a higher-definition static image. 
[0027] 

The image generation equipment mentioned above can be suitably changed including 
various kinds of modes as thought of that it may carry out with other approaches in the 
condition of carrying out independently and having been included in a certain device, and 
invention. 

Moreover, invention exists also in the approach of performing processing corresponding to 
the means mentioned above according to the predetermined procedure. Therefore, this 
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invention can be applied also as the control approach of image generation equipment, and 
serves as the same operation fundamentally also in invention concerning claim 13. 
Furthermore, it can apply as a print control unit which performs printing control to the 
airhne printer which prints based on the generated image data, can apply also as a 
printing system equipped with this print control unit and an airhne printer, and becomes 
the same operation fundamentally. 
[0028] 

In case it is going to carry out this invention, a predetermined program may be performed 
with the above-mentioned equipment. Then, it can apply also as a control program of 
image generation equipment, and becomes the same operation fundamentally also in 
invention concerning claim 14. Furthermore, the medium which recorded this program 
circulates and it is possible to read a program into a computer from this record medium 
suitably. That is, it can apply also as a record medium which recorded the program and in 
which computer reading is possible, and becomes the same operation fundamentally. 
Of course, it is possible to also make the configuration indicated to claim 2 - claim 12 
correspond to the medium which recorded the above-mentioned approach, the print control 
unit, the printing system, the program, and the program. 

Here, the above-mentioned record medium may be what kind of record medium developed 
from now on besides a magnetic-recording medium or a magneto-optic-recording medium. 
Duplicate phases, such as a primary replica and a secondary replica, are not asked, either. 
It is contained in the thought of this invention, when a part is reaUzed by hardware, or also 
when recording the part on the record medium and reading suitably if needed. 
[0029] 

[Embodiment of the Invention] 

Hereafter, the operation gestalt of this invention is explained according to the following 
sequence. 

(1) Configuration of a printing system * 

(2) Outline of the configuration of image generation equipment ' 

(3) Example of image quaUty setting information • 

(4) Presumption of a camera motion • 

(5) Processing which image generation equipment performs - 
(5-1) Logging of the synthetic range ' 

(5-2) Detection of the amount of advancing side by side, and a rotation • 
(5-3) Gap amendment of a fi:ame image • 
(5-4) Composition of a firame image ' 

(6) Second operation gestalt • 

(7) Third operation gestalt • 

(8) Fourth operation gestalt 

(9) Conclusion - 
[0030] 

(1) Configuration of a printing system : 
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Drawing 1 shows the outline configuration of the printing system 100 which is 1 operation 
gestalt of this invention. This system 100 consists of ink jet printer 20 grades which are a 
personal computer (PC) 10 and an airline printer (image output unit) and which can be 
color-printed. In addition, PC 10 serves as image generation equipment said to this 
invention in the semantics which generates the image data expressing a static image 
(output image of an image output unit) firom two or more firame information on image 
information. Moreover, it becomes a print control unit in the semantics which, makes a 
printer 20 print the static image which generates image data and corresponds. 
PC 10 is equipped with CPUll which makes the center of data processing, and this CPUll 
controls the PC 10 whole through system bus 10a. ROM 12, RAM13, DVD-ROM drive 15, 
I/O 17a for 1394, various interface (I/F) 17 b-e, etc. are connected to this bus 10a. Moreover, 
. the hard disk (HD) 14 is also connected through the hard disk drive. Although the desktop 
mold PC is adopted as the computer of this operation gestalt, what has a general 
configuration as a computer is employable. 
[0031] 

The appHcation program (APL) which can create an operating system (OS), image 
information, etc. is stored in HD14. At the time of activation, while CPUll transmits such 
software to RAM13 suitably and accesses RAM13 suitably as a temporary work area, a 
program is performed. 

I/O 17a for 1394 is I/O based on IEEE 1394 specification, and digital camcorder 30 grade is 
connected. This video camera 30 generates image information, and an output is possible 
for it to PC 10. Display 18a which displays the image based on firame information or image 
data is connected to CRTI/F17b, and keyboard 18b and mouse 18c are connected to input 
I/F 17c as an input device for actuation. Moreover, the printer 20 is connected to printer 
I/F17e through the parallel I/F cable. Of course, it is good also as a configuration which 
connects a printer 20 through a USB cable etc. 
[0032] 

The ink of C (cyanogen), M (Magenta), Ye (yellow), and K (black) is used for a printer 20, 
and it prints discharge and an image for ink so that it may become the amount of ink 
corresponding to the gradation value which constitutes image data to a print sheet (print 
media). Of course, the printer which uses ink other than 4 colors may be adopted. Moreover, 
the printer of the bubble method which is made to generate a bubble and carries out the 
regurgitation of the ink into an ink path, and various airline printers, such as a laser beam 
printer, are employable. 

As shown in drawing 2 , by the printer 20, CPU21, ROM22, RAM23, communication link 
I/024, control IC25 and ASIC26, 1/F27, etc. are connected through bus 20a. 
Communication link I/024 is connected with printer I/F17e of PC 10, and a printer 20 
receives the print job which consists of data changed into CMYeK transmitted fi^om PC 10 
through communication link I/024, a Page Description Language, etc. ASIC26 outputs the 
appUed'voltage data based on CMYeK data to head mechanical-component 26a, 
transmitting and receiving CPU21 and a predetermined signal. This head 
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mechanical' component 26a generates the applied'voltage pattern to the piezo^electric 
element built in the print head based on these applied-voltage data, and makes the print 
head breathe out the ink of CMYeK. Carriage device 27a and carriage 27b which were 
connected to I/F27 carry out horizontal scanning of the print head, or performing newpage 
actuation suitably, have sent out media one by one and perform vertical scanning. And 
CPU21 controls each part according to the program written in ROM22, using RAM23 as a 
work area. 
[0033] 

In PC 10, BIOS is performed on the basis of the above hardware, and OS and APL are 
performed in the upper layer. Various kinds of drivers, such as a printer driver which 
controls printer I/F17e, are included in OS, and control of hardware is performed. A printer 
driver can perform the communication link of a printer 20 and both directions through 
printer I/F17e, receives image data from APL, creates a print job, and sends it out to a 
printer 20. Although the image generator of this invention consists of APL, it may be 
constituted by the printer driver. Moreover, although HD14 is the medium which recorded 
this program, this medium may be print media by which signs, such as DVD-ROM 15a, 
CD-ROM, a flexible disk, a magneto-optic disk, nonvolatile memory, a punch card, and a 
har code, were printed. Of course, it is also possible to download and perform the 
above-mentioned control program stored in the predetermined server through the Internet 
network from communication link I/F17d. 

And the above-mentioned hardware and the above-mentioned program collaborate, and 

image generation equipment is built. 

[0034] 

(2) Outline of the configuration of image generation equipment - 

Drawing 3 shows typically the outline of the configuration of the above-mentioned image 
generation equipment. The image generator as which PC is operated as image generation 
equipment UO consists of two or more modules corresponding to the various means 
expressed below. 

The image information Dl has much frame information D2. Let each frame information D2 
be the information which carried out the gradation expression of the frame image by 
dot-matrix'like many pixels. Such frame information D2 is the information which followed 
time series. Drawing shows the order of time series, i.e., right-hand side, as next 
information in order of time series toward right-hand side from left-hand side. The frame 
acquisition means Ul first determines several n (n is two or more integers) of the frame 
information which acquires the image quality setting information DIO whose setup of the 
image quality of the output image of a printer 20 is enabled, and is acquired from the 
image information D 1 based on this image quality setting information D 10. He is trying to 
increase the number of the frame information acquired, so that the image quality setting 
information DIO is the information which expresses high definition more, as shown in the 
graph in drawing in that case. He is trying in other words to reduce the number of the 
frame information acquired, so that the image quality setting information DIO is the 
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information which expresses a high speed more. Here, it was indicated as "n" for 
explaining plainly, and in order for what is necessary to be just to be able to acquire a 
number of determined frame information later, it does not necessarily mean acquiring the 
numerical information "n." 
[0035] 

Next, the determined several n frame information is acquired from the image information 
Dl. With this operation gestalt, two or more frame information D3 which followed time 
series is acquired from the image information Dl. Moreover, the first firame information is 
nlade into the reference frame information D31 at the order of time series, and frame 
information (the example of drawing three) which continues after that is made into the 
object frame information D32. Of course, anything may be made into reference frame 
information among two or more frame information, and reference frame information may 
not be two or more acquired frame information. 
[0036] 

Drawing 4 shows the configuration of the frame information D2 typically, it is shown in 
drawing as " each frame information D2 dot-matrix-Uke many pixels 51 - another 
gradation data D8 are expressing the frame image. Although they are explained that the 
gradation data D8 of this operation gestalt are YCbCr data which consist of Y (brightness), 
Cb (blue color difference), and Cr (color difierence of red), they may be RGB data which 
consist of R (red), G (Green), and B (blue). Moreover, although it is explained that YCbCr 
each component is 256 gradation, it may be 1024 gradation, 100 gradation, etc. 
[0037] 

The amount acquisition means U2 of gaps detects the amount of advancing side by side 
showing the rotation showing the rotation gap between the images expressed for two or 
more frame information, or an advancing'side'byside gap based on a number of frame 
information D3 acquired with the frame acquisition means Ul (equivalent to the amount 
detection means of gaps), and acquires the rotation information D4 and the amount 
information D5 of advancing side by side. Although he is trying to detect each remaining 
rotation and remaining amount of advancing side by side of the object frame information 
D32 from the reference frame information D31 on the very first in the order of time series 
with this operation gestalt, it is possible to detect a rotation and the amount of advancing 
side by side in various modes by any are made into reference frame information. 
[0038] 

As shown in drawing 5 , many pixels of frame information will be expressed on xy flat 
surface, and frame information 52a of an upper case and b shall be made into the order of 
time series, and also let frame information 52c of the lower berth, and d be the order of 
time series. As shown in the upper case of drawing, the movement magnitude u of the 
direction of a x axis when carrying out a parallel displacement, without object 53a on 
frame information 52a rotating (= 1 pixel) and the movement magnitude v of the direction 
of the y-axis (= 2 pixels) are the amounts of advancing side by side, and serve as the 
amount information of advancing side by side said to this invention. Moreover, as shown in 
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the lower berth of drawing, when the amounts of advancing side by side (u, v) are (0, O), a 
rotation (delta) in case object 53c on frame information 52c rotates the core 52c 1 of frame 
image 52c as the center of rotation serves as rotation information. 
[0039] 

The amount acquisition means U2 of gaps of this operation gestalt asks for a rotation gap 
and an advancing*side-by-side gap using the operation expression which asks for the 
rotation gap and advancing-side'by side gap between the images expressed for two or more 
frame information by the least square method based on the location and the gradation data 
of a pixel of the pixel of two or more frame information D3, and he is trying to acquire the 
rotation information D4 and the amount information D5 of advancing side by side. The 
technique of asking for this rotation gap and an advancing-side-byside gap is made to call 
it "presumption of a camera motion (Camera Motion)." 
[0040] 

The conversion means U3 rotates at least one of each of the image expressed for two or 
more frame information D3 based on both the information D4 and D5, or it performs 
transform processing which changes at least one of two or more of the frame information 
D3 so that it may be made to advance side by side and the gap between images may be 
lessened. The conversion means U3 of this operation gestalt generates two or more frame 
information D6 on two or more frame information D3 that specifically changed the object 
frame information D32 at least one, and transform processing was performed so that the 
gap between images may be lost. The location of each at least one pixel of two or more 
frame information is changed in a unit finer than the pixel concerned in that case. 
[0041] 

Here, when the second frame image is in the degree of the first frame image, the amount of 
advancing side by side from a frame image to the first frame image [ second ] presupposes 
that (u, v), and a rotation are (delta). For example, when losing the gap with the first frame 
image about the second frame image, the second frame image is made to advance side by 
side (- u, -v), and is rotated (-delta). Of course, while making the first frame image advance 
side by side (u/2, v/2) and rotating it (delta/2), the second frame image may be made to 
advance side by side (-11/2, ■v/2), and may be rotated (*delta/2). 
[0042] 

The synthetic means U4 compounds two or more frame information D6 that transform 
processing was performed, and generates image data D7. Let frame information D6 to 
compound be the number acquired with the frame acquisition means Ul. This image data 
is data which carry out the gradation expression of the output image of a printer 20 by 
dot-matrix'Uke many pixels. Although it is explained that the image data D7 of this 
operation gestalt is RGB data of RGB 256 gradation each, you may be YCbCr data etc. and 
the numbers of gradation may also be 1024 gradation, 100 gradation, etc. Frame 
information differs from the number of pixels, and the image data of this operation gestalt 
is explained as what the number of pixels is made [ many ] and is high-resolution-ized 
rather than frame information. In addition, the image data generated may be made into 
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the same number of pixels as frame information, and may be made into the number of 
pixels smaller than frame information. 

Carrying out sequential migration of the attention pixel which generates image data, in 
case two or more frame information is compounded, predetermined interpolation 
processing is performed using the gradation data of the pixel which exists around an 
attention pixel among all the pixels of two or more frame information, the gradation value 
of an attention pixel is calculated, and the image data D7 which expresses a static image 
with the gradation value according to pixel is generated. 
[0043] 

In the Prior art, since the frame information number to compound was being fixed, the 
processing time which generates image data to the image quahty searched for beyond the 
need might start. Since it is compounded and generated from a number of frame 
information automatically determined based on the image'quality setting information 
which makes possible [ a setup of the image quahty of an output image ] for the static 
image expressed by the image data generated with this image generation equipment UO, it 
becomes that it is possible in performing efficiently the processing which generates the 
image data e:q)ressing a static image, and obtaining a static image efCLciently by 
compounding a suitable number suitable for the image quality of an output image of frame 
information. Since especially the number of the frame information compounded, so that 
image quality setting information turns into information which means high definition 
more increases, a higher-definition static image is obtained, and since the number of the 
frame information compounded, so that image quality setting information turns into 
information which means low image quality more decreases, a static image can be obtained 
more quickly. 
[0044] 

(3) Example of image quality setting information ^ 

Drawing 6 shows the example of the above*mentioned image quality setting information. 
For example, it is [ whenever / improvement / which is the multiplier by which the ratio of 
the total of the pixel in the frame information over the total of the pixel in the image data 
to generate is multiplied / in image quality ] good also considering V as image quality 
setting information (the 1). said - if the value which multiplied the ratio by V whenever 
[ improvement in image quality ] is calculated and the number which acquires frame 
information will be determined so that abbreviation coincidence may be carried out with 
the value concerned, a number of frame information with which processing which 
generates the image data expressing a static image is performed efficiently will be 
acquired and compounded. In addition, whenever [ improvement in image quahty ], V is 
made into the same value as the image quahty mode setting value set up by the actuation 
input to the image quahty mode input column, its number of the frame information 
acquired, so that a value becomes large increases so that it may mention later, and it is 
high'definition-ized. 
[0045] 
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It is good among the pixels of two or more frame information about each pixel in the 
above-mentioned image data also considering the threshold THl about the arithmetical 
mean (value which summarized distance) of the distance to the nearest pixel as image 
quality setting information (the 2). About each pixel in this image data, among the pixels of 
two or more acquired frame information, the distance to the nearest pixel is computed, and 
a number of frame information with which one or less threshold TH or processing which 
will generate the above-mentioned image data if frame information is acquired until it 
becomes smallness more is efficiently performed for the average value of the computed 
distance is acquired and compounded. 

It is good also considering the threshold TH2 about a number of frame information of 
arithmetical means (value which packed the number) which have the pixel which becomes 
predetermined within the limits about each pixel in the above-mentioned image data as 
image quality setting information (the 3). About each pixel in this image data, it asks for 
the number of the frame information which has the pixel which becomes predetermined 
within the limits, and a number of frame information with which two or more thresholds 
TH or processing which will generate the above-mentioned image data if frame 
information is acquired until it becomes size more is efficiently performed for a number of 
average values for which it asked is acquired and compounded. 
[0046] 

It is good also considering the threshold TH3 about the ratio of the number which is the 
pixel in which the pixel of the frame information which becomes predetermined within the 
limits among the pixels in this image data to the total of the pixel of the above-mentioned 
image data does not exist as image quality setting information (the 4). It asks for the 
number which is the pixel in which the pixel of the frame information which becomes 
predetermined within the limits among the pixels in this image data does not exist, it ** in 
the total of the pixel of this image data, and a number of frame information with which 
three or less threshold TH or processing which will generate the above-mentioned image 
data if frame information is acquired until it becomes smallness more is efficiently 
performed for the ratio which asked for and asked for the ratio is acquired and 
compounded. 

In addition, thresholds THl and TH3 are made small, and the threshold TH2 is enlarged, 
so that it is a setup made more into high definition. 

Such image quahty setting information is memorized by HD as a correspondence table 
made to correspond to an image quality mode setting value. It becomes possible to obtain a 
static image efficiently by reading image quality setting information and determining the 
number of the frame information acquired from image information based on this image 
quality setting information. 
[0047] 

(4) Presumption of a camera motion : 

It not only amends the advancing-side-by-side gap between frame imaiges, but with this 
operation gestalt, presumption of a camera motion has amended the rotation gap between 
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frame images. Presumption of a camera motion presumes the relative physical 
relationship of two or more frame images e3q>ressed for two or more frame information 
started from image information. Here, there is no motion of the installation location of the 
photography object itself and a video camera during photography, and it is assumed that it 
is that from which only the sense of a video camera is changing. That is, it is equivalent to 
the camera work called a pan and a tilt. Moreover, in order to explain plainly, it shall 
suppose that there is an object frame image expressed by the degree of the reference frame 
image expressed for reference frame information for object frame information, and the 
ainount of gaps of a reference frame image and an object frame image shall be presumed. 
[0048] 

As shown in drawing 7 , the coordinate (xl, y 1) of reference frame information shall be 
equivalent to the coordinate (x2, y2) of object frame information. The amount of advancing 
side by side is setting (u, v), and a rotation to delta by making the core of a frame image 
into a zero. Since it is premised on not changing a focal distance at the time of photography, 
a degree type is used as a formula of coordinate transformation on the assumption that 
conversion of only advancing side by side and rotation. 
x2 = cos delta-x 1 + sin delta-y 1 - u (1) 
y2 = -sin delta-x 1 + cos delta-y 1 ■ v - (2) 

In addition, since the time difference of a reference frame image and an object frame image 
is very few, u, v, and delta become a minute amount. Here, since it is cosdelta**l and sin 
delta'^'^delta when delta is a minute amount, an upper type can be replaced as follows. 
x2 = xl + Delta-y 1 - u ■ (3) 
y2 = ■ delta-x 1 + yl - v - (4) 

And u, V, and delta of a formula (3) and (4) are presumed with a least square method. 
[0049] 

Presumption of a camera motion is based on the gradient method (the gradient method) 
which presumes the location of a pixel in a unit finer than 1 pixel using the brightness of 
each pixel between frame information. 

Here, as shown in the upper case of drawing 8 , the brightness of each pixel of reference 
frame information is made to express the brightness of each pixel of zl (ix, iy) and object 
frame information as z2 Gx*, iy'). First, the technique of searching for a coordinate (ix*, iy') 
with a gradient method is explained as what has the coordinate (ix', iy') of object frame 
information between the coordinates (ix-ix +1, iyiy -»-l) of reference frame information. 
[0050] 

What is necessary is just to calculate delta x which is set to Px-delta x=z2(ix*, iy')-zl (ix, iy), 
if [ make the location of the direction of a x axis of a coordinate (ix', iy') into ix+delta x, 
and ] Px=zl(ix-t-l, iy)-zl (ix, iy), as shown in the middle of drawing. In fact, delta x will be 
computed about each pixel and an average wUl be taken on the whole. What is necessary is 
here, just to compute delta x of which the following formulas consist, if only expressed with 
zl=2l (ix, iy) and z2=z2 (ix', iy'). 
{Px-delta X - (z2-zl) 2 } = 0 - - (5) 
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Moreover, what is necessary is just to ask for deltay which is set to Py delta y=z2(ix', iy')"zl 
(ix, iy), if [ set the location of the direction of the yaxis of a coordinate (ix*, iyO to iy+deltay, 
and ] Py=zl(ix, iy+l)-zl Gx, iy), as shown in the lower berth of drawing. What is necessary 
is here, just to compute deltay of which the following formulas consist, if only expressed 
with zl=zl (ix, iy) and z2=z2 (ix', iyO. 
{Py-delta y ■ (z2-zl) 2 } = 0 - (6) 

Then, what is necessary is just to ask for deltiax and delta y which make S2 of the following 
formulas min with a least square method, if xy both directions are taken into consideration. 
S2 = Sigma {Px-delta x + Py delta y - (z2-zl)} 2 - (7) 
[0051] 

In the above, the technique of calculating the amount of advancing side by side was 
explained that the frame image carried out the parallel displacement in the direction of a x 
axis, and the direction of the yaxis with the gradient method. In this invention, rotation of 
a frame image is also further taken into consideration. Hereafter, the technique is 
explained. 

If r and angle of rotation from a x axis are set to theta for the distance from the zero O of 

the coordinate (x y) of reference frame information as shown in drawing 9 , r and theta will 

be called for by the following formulas. 

r = (x2 + y2) 1/2 - (8) 

theta = tan-1 (x/y) (9) 

[0052] 

Here, the zero of a reference frame image and an object frame image is doubled, and 
supposing it does delta rotation of from a coordinate (x y) and becomes a coordinate (x*, y'), 
by the object frame image, the movement magnitude of the direction of a x axis and the 
movement magnitude of the direction of the yaxis by this rotation will be calculated by the 
following formulas, noting that the advancing' side *by side gap is amended, 
x' - X ** -rdeltasintheta = • delta-y (lO) 
yi - y ** rdeltacostheta = Delta-x - (11) 

Then, deltax and delta y in the above-mentioned formula (7) are expressed with the 
following formulas using the amounts u and v of advancing side by side, and a rotation 
delta. 

delta X = u ■ Delta y - (12) 
deltay = v + Delta x - (13) 

The following formulas will be obtained if these are substituted for the above-mentioned 
formula (7). 

S2 = Sigma {Px, + Py, and (v+delta-x) - (z2-zl)} 2 - (14) 
[0053] 

Namely, what is necessary is just to ask for u, v, and delta which make S2 min with a least 
square method, when the coordinate value and gradation data (brightness value) of all 
pixels of reference frame information are substituted for a formula (14) for the coordinate 
of reference frame information as (ix, iy). The following formulas can be obtained with a 
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least square method. 
[Equation l] 



However, i is a number which distinguishes all pixels, and alpha, beta, D, N1-N5, and M 
are the foUowings, and are made and called for. 
[Equation 2] 
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[0054] 

Therefore, using above-mentioned formula (15) - (29) which asks for the rotation gap and 
advancing-side-by-side gap between frame images with a least square method, a camera 
motion can detect the amount of advancing side by side (u, v), and a rotation (delta), and 
these, can be acquired as the amount information of advancing side by side, and rotation 
information. Here, since the amount of advancing side by side is made into the unit smaller 
than the pixel of a frame image, it is detectable with a sufi&cient precision. And if two or 
more frame information is compounded using the amount of advancing side by side and 
rotation which were detected, it will become possible to obtain a high'definition static 
image from two or more frame information on image information. 
[0055] 

In addition, before performing the above-mentioned presumption, the amount of advancing 
side by side is detected per pixel only about an advancing-side-byside gap, and the 
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advancing-side-byside gap between frame images may be amended per pixel (roughly). 
Then, the amount information of advancing side by side and rotation information can be 
acquired with a still more sufficient precision, and it becomes possible by compounding two 
or more frame images using the amount information of the said advancing side by side, 
and rotation information to obtain a frirther high -definition static image. 
As shown in drawing 10 , the presumed technique by the pattern matching method is 
known by making the advancing-side-byside gap between frame images into the technique 
detected roughly. As shown in the upper case of drawing, the brightness of each pixel of 
reference frame information is made to express the brightness of the pixel of the same 
location as z2 (ix, iy) in zl (ix, iy) and object frame information. 

First, the following L searches the location which becomes the smallest, shifting object 
frame information in x directions or the direction of y per 1 pixel on the basis of the case 
where the pixel (ix, iy) of reference frame information is made equivalent to the pixel (ix, 
iy) of object frame information. 
L= |Z2rZli| (30) 
or 

L = (Z2i-Zli)2"(3l) 
[0056] 

And when the location of the pixel of the object frame information that it is made to 
correspond to the pixel (ix, iy) of reference frame information at the time of retrieval 
termination is set to (ix-delta x and iydeltay), the amount of advancing side by side from a 
reference frame image to an object frame image can be expressed as (deltax, delta y) as a 
pixel unit. 

Then, if only the amount of advancing side by side (deltax, delta y) shifts the pixel about 
object frame information, a camera motion can be presumed with high degree of accuracy. 
[0057] 

(5) Processing which image generation equipment performs - 

Hereafter, actuation is explained to the detail with the processing which image generation 
equipment performs. 

Drawing 11 shows the processing which this image generation equipment performs with 
the flow chart. Specifically according to the image generation APL, CPU 11 of PC 10 
performs this processing. This APL is the application for generating the scene of 
arbitration in the image curre^ntly reproduced on PC as a still picture. This still picture is a 
high definition still picture which did not only start one frame but compounded the 
multiple frame. 
[0058] 

(5"l) Logging of the synthetic range 

If the image generation APL is started, the image file designation screen which is not 
illustrated will be first displayed on a display, the actuation input which specifies an image 
file from the user of image generation equipment will be received, and the information 
showing the memory address of an image file will be acquired (S105.). Hereafter, the 
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publication of a "step" is omitted. Next, the image file of the memory address is opened 
(opening), and it memorizes in RAM by making into pointer information information which 
receives the input which chooses the frame image of a part to generate as a static image 
from the frame image of a large number in which graphic display is carried out by this 
image file, and expresses the corresponding memory address of frame information (SI 10). 
[0059] 

Drawing 12 shows the frame image selection iscreen. If an image file is opened, the frame 
information on top will be acquired from the image information which consists of frame 
information on a large number stored in this image file in order of time series, and the 
initial screen 81 shown in the left-hand side of drawing will be displayed. Frame 
information is data which expressed the image by the YCbCr data according to many 
pixels (gradation data). In graphic display column 81a of this screen 81, a frame image is 
displayed based on the frame information on top. Carbon button 81b [ various ] and c are 
prepared in this graphic display column 81a bottom, and if click actuation of these carbon 
buttons is carried out with a mouse, a user can make it move to a desired scene. If click 
actuation of the control carbon button 81b is carried out, pointer information will be 
changed according to actuation and a frame image will be updated. And if click actuation of 
the earth-switch 81c is carried out, the frame image based on the frame information on a 
corresponding memory address will be displayed. The frame image selection screen 82 at 
this time is shown in the right-hand side of drawing. 

Here, if click actuation of the scene acquisition carbon button 82a is carried out, it will 
mean receiving the selection input of a frame image, and will move to the processing which 
acquires the scene of the as a still picture. 
[0060] 

The dialog box 83 of a scene acquisition setting screen as shown in drawing 13 is displayed 
immediately after that, and the setting input in the horizontal resolution (the number of 
pixels of the direction of a x axis) W, the vertical resolution (the number of pixels of the 
direction of the yaxis) H, and image quality mode is received (SI 15). In a dialog box 83, 
while displaying the resolution of the frame image which becomes the origin to compound 
on image resolution display column 83a, 83d of the image quahty mode input columns 
which can be set up in five steps, various carbon button 83g, and h are displayed [ the 
resolution of the image made to generate ] for the image quality of resolution input column 
83b and c which can be specified [ that it is arbitrary and ], and the image made to 
generate. In horizontal resolution input colunm 83b, the actuation input of horizontal 
resolution is received, the value of W is acquired, the actuation input of vertical resolution 
is received in vertical resolution input column 83c, and the value of H is acquired. In 83d of 
the image quaUty mode input columns, 83f of accommodation tongues which can be shd is 
displayed as straight-line -like slot 83e along with slot 83e by mouse actuation. Here, five 
steps of image quality modes are formed, and a left end is made into the quick (high speed) 
mode, and let the right end be the beautiful (highest image quality) mode. And 1, 2, 3, 4, 
and 5 are acquired in order as an image quality mode setting value as 83f of 
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accommodation tongues becomes a right end from a left end. If click actuation of the O.K. 
carbon button 83g is carried but in the example of drawing, the number of pixels of a 
generation image will be set to W= 1280 and H= 960, and an image quality mode setting 
value will be set to 3. Thus, in a dialog box 83, the number of pixels and image quality of a 
generation image can be specified now. 

Thus, since the number of pixels of a static image (resolution) can be changed and image 
quality can be changed, it becomes possible to obtain a satisfactory static image. Since this 
image generation equipment can generate the image data which expresses a 
high- definition static image by compounding two or more frame information, by setting a 
static image as high resolution rather than a frame image, the number of pixels can obtain 
the high-definition static image made [ many ], and becomes possible [ obtaining a more 
satisfactory static image ]. 

In addition, you may make it make a dilation ratio and printing size specify instead of 
resolution. 

If click actuation of the O.K. carbon button 83g is carried out, based on an image quality 
mode setting value, V will be acquired whenever [ improvement / which enables a setup of 
the image quality of an output image / in image quaUty 1 (S120). Although an image 
quality mode setting value is considered as whenever [ improvement in image quaUty / V ] 
as it is with this operation gestalt as drawing 6 showed, V may differ from the image 
(quality mode setting value whenever [ improvement in image quality ]. 
[0061] 

Next, based on V, the nl number of the frame information acquired from image 
information is determined whenever [ improvement in image quahty ] (S125). In the 
number of horizontal pixels of frame information, when w and the number of vertical pixels 
are set to h and the frame information number to compound is set to nl, a total of V of the 
number of pixels of the frame information before the composition per pixel of the static 
image after composition is expressed with the following formulas. 
V=nl and (w-h)/(W-H) (32) 

It becomes. Here, it is Sx=W/w when the dilation ratio of Sx and a lengthwise direction is 
set to Sy for a lateral dilation ratio. Since it is Sy=H/h, it can also express with the 
following formulas. 
V=nl/(Sx-Sy) " (33) 

Whenever [ improvement in image quality ], the value of V is the data density per pixel, 
and since they are image quaUty and a value concerned closely, it can make the value of V 
the standard of the improvement in image quality. 
[0062] 

Deformation of the above-mentioned formula (32) and (33) obtains the following formulas. 
nl=V and (W-H)/(w-h) - (34) 
nl=V- (Sx-Sy) - (35) 

Therefore, if the standard of image quality is specified by V whenever [ improvement in 
image quality ] when compounding two or more frame information, and the number of 
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pixels and the dilation ratio are specified, the fi-ame information number nl required to 
compound can be determined. In addition, in S125, the firame information number nl 
acquired based on V whenever [ total wh / of the pixel in firame information / and 
improvement in image quaUty ] is computed using the above-mentioned formula (34). By 
using the above-mentioned formula (34) and (35), before compounding the frame 
information number compounded with a simple configuration, it is calculable. 
Since V also becomes large here whenever [ improvement in image quaUty 1 so that an 
image quality mode setting value becomes large, it becomes the information which 
expresses high definition more, so that V becomes large whenever [ improvement in image 
quality ], and the number of the frame information to acquire increases, and it becomes 
possible to obtain a higher-definition static image. On the other hand, it becomes the 
information which expresses high-speed processing more, and the number of the frame 
information to acquire becomes fewer, and processing which generates the image data 
which expresses a static image more at high speed is performed, so that V becomes small 
whenever [ improvement in image quality ]. Therefore, it becomes possible to perform this 
processing efficiently and to obtain a static image. 
[0063] 

Decision of a frame information number acquires a number of determined frame 
information from image information (S130). When the determined frame information 
number nl is not an integer, it is made an integer by rounding off nl, revaluing below 
decimal point, or omitting etc., and frame information is acquired. Although he is trying to 
acquire the frame information which followed time series from image information with this 
operation gestalt, even if it acquires two or more discrete frame information which is not 
following time series, it is possible to detect the amount of advancing side by side and a 
rotation, to compound frame information, and to obtain a static image, for example, the 
un-independent frame information which cannot express an image as the independent 
frame information which can express an image unless it does not have gradation data of all 
pixels but refers to other frame information without having gradation data of all pixels and 
referring to other frame information -- since - when image information is constituted, it 
becomes possible by referring to only discrete independent frame information to perform 
the following camera motion presumption processings at high speed. 
As explained above, PCIO which processes S105-S130 constitutes a frame acquisition 
means. 
[0064] 

(5*2) Detection of the amount of advancing side by side, and a rotation • 

Then, camera motion presumption processing which presumes the amount of advancing 

side by side and rotation of a frame image by the camera motion, and acquires the amount 

information of advancing side by side and rotation information with the amount 

acquisition means of gaps and the amount detection means of gaps is performed (S135). 

Drawing 14 shows camera motion presumption processing with the flow chart. 

First, reference frame information is set up out of two or more frame information acquired 
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from image information (S205). With this operation gestalt, the frame information on the 
very first is set up with reference frame information in order of time series. Here, by 
storing in the predetermined field in RAM the frame information made into reference 
frame information, reference frame information may be set up and reference frame 
information may be set up by storing in the predetermined pointer in RAM the memory 
address of the frame information made into reference frame information. 
[0065] 

Next, object frame information is set up out of two or more frame information acquired 
from image information (S210). For example, object frame information is set up out of the 
remainder except frame information, such as setting the second frame information as 
object frame information in order of time series, to the acquired reference frame 
information. Here, the frame information made into object frame information may be 
stored in the predetermined field in RAM, and the memory address of the frame 
information made into object frame information may be stored in a predetermined pointer. 
[0066] 

Furthermore, the various variables (parameter) used for above-mentioned formula (15) - 
(29) which computes the rotation delta as which the amounts u and v of advancing side by 
side as which the advancing- side -by- side gap was expressed by the least square method, 
and a rotation gap were expressed are initiaUzed (S215). For example, 0 is substituted for 
the variables M20, Mil, M02, mu, and mv which compute total, mdelta, cu and cv, and 
cdelta. 

Then, the location of the attention pixel i is set up from reference frame information, and 
the location of attention pixel i' is set up from object frame information (S220). For example, 
when constituted in the shape of [ whose frame information is a horizontal (direction of x 
axis) nx pixel, and a vertical (direction of the y-axis) ny pixel ] a dot matrix. In case the 
pixel of the coordinate (ix, iy) of reference frame information is made into an attention 
pixel In case the location of the attention pixel i can be set up by i=ix+nxxiy and the pixel of 
the coordinate (ix*, iy 0 of object frame information is made into an attention pixel, the 
location of attention pixel i' can be set up by i— ix'+nxxiy'. With this operation gestalt, it 
starts from an upper left pixel, sequence of setting up the location of an attention pixel is 
carried out to to an upper right pixel at sequence, and it carries out it one [ at a time ] to to 
a right end pixel from the pixel of a lower left end after that at sequence, and it is made 
into the lower right pixel at the last. Hereafter, it is made the same also when setting up 
the location of an attention pixel by various processings. Of course, sequence of setting up 
the location of an attention pixel can also be considered as sequence which can change 
suitably and is different according to the class of frame image etc. 

In addition, before processing S220, the rough amount of advancing side by side from a 
reference frame image to an object frame image (deltax, delta y) may be detected by the 
pattern matching method mentioned above, it may acquire, and only the amount of 
advancing side by side (deltax, delta y) may shift a pixel. 
[0067] 
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If the location of the attention pixel i and i* is set up, Pti, ki, M20, Mil, M02, mu, mv and 
mdelta which are used for above-mentioned formula (18) - (28), cu and cv, and cdelta will 
be operated sequentially (S225). For example, since it is necessary to compute total about 
M20, it is about a variable M20, 

M20 <■ M20 + (the attention pixel i, value in sigma of iO 

Processing adding the value in sigma of ****** i, i.e., an attention pixel, and i* is performed. 
And it judges whether it calculated about the various above-mentioned variables about all 
the pixels of reference frame information (S230). When S220-S230 are processed 
repeatedly and the various above-mentioned variables are calculated ahout all pixels, 
carrying out sequential migration of the attention pixel i and i* which calculate the various 
above-mentioned variables when the pixel which is not calculating the various 
above-mentioned variables remains, it progresses to S235. 
[00681 

In S235, d is computed using the above-mentioned formula (29). 
Next, the amounts u and v of advancing side by side are computed using the 
above-mentioned formula (15) and (16) (S240), and a rotation delta is computed using the 
above-mentioned formula (17) (S245). That is, it means that it was detected in the unit 
with the amount of advancing side by side and rotation showing the advancing-side-by-side 
gap and rotation gap between the images expressed for two or more frame information 
finer than 1 pixel, and means that it was acquired as the amounts u and v of advancing 
side by side the amount information of advancing side by side and whose rotation 
information are numerical information, or a rotation delta. And u, v, and delta are 
memorized to the predetermined field in RAM (S250). 
[0069] 

Then, it judges whether u, v, and delta were acquired about aU frame information (S255). 
This flow is ended when object frame information is set up in order of time series, 
S205-S255 are repeatedly processed, when the frame information which does not acquire u, 
V, and delta remains, and u, v, and delta are acquired about all frame information. 
By the above processing, the amount of advancing side by side (u, v) and a rotation (delta) 
can be detected, and these can be acquired as the amount information of advancing side by 
side, and rotation information. Since location conversion of each pixel of frame information 
is performed by high degree of accuracy in a unit finer than the pixel concerned in that 
case, it becomes possible to obtain a high-definition static image. Moreover, since a 
rotation and the amount of advancing side by side are detectable at high speed by using 
the operation expression which asks for the rotation gap and advancing-side-by-side gap 
between frame images with a least square method, it becomes possible to make the 
processing which generates image data accelerate. 

In addition, according to the property of a frame image etc., u, v, and delta are multiplied 
by the predetermined correction £actor, and it is good also as the amount information of 
advancing side by side, and rotation information. 
[0070] 
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(5'3) Gap amendment of a frame image < 

Then, transform processing which changes object frame information is performed so that it 
progresses to S140 of drawing 1 1 , it may be made to rotate while making an object frame 
image advance side by side with a conversion means based on the amount information of 
advancing side by side, and rotation information, and the gap with a reference frame 
image may be lost. 

Drawing 15 shows frame transform processing with the flow chart. 

First, the object frame information that the coordinate of a pixel is changed is set up out of 
object frame information like S210 of drawing 14 (S305). Next, the location of attention 
pixel i' which carries out coordinate transformation from object frame information is set up 
like S220 of drawing 14 (S31Q). 
[0071] 

Then, it is in the direction of a x axis about the location of attention pixel i' so that the 
amounts u and v of advancing side by side may be read from RAM and an 
advancing- side -by- side gap of an object frame image may be canceled. - Coordinate 
transformation is carried out so that - v advancing side by side of may be made to do in u 
and the direction of the yaxis (S3 15). That is, the parallel displacement of the location of 
attention pixel i* of a coordinate (ix*, iy') is carried out to a coordinate (ix* ■ u, iy* ■ v). Here, a 
coordinate (ix* - u, iy * - v) is an analog quantity, and is made finer than the pixel of frame 
information. 

Furthermore, a rotation delta is read from RAM, and coordinate transformation is carried 
out so that a rotation gap of an object frame image may be canceled, and 'delta rotation of 
the location of attention pixel i* may be further done by making the core of a frame image 
into a zero (S320). If a coordinate (ix* • u, iy* ■ v) is transposed to the coordinate (x', yO 
centering on a zero and distance from a zero to a coordinate (x', yO is made into r* here, a 
coordinate (x', y') is in the direction of a x axis by rotation of -delta. - It delta-x 'moves in 
delta-y* and the direction of the yaxis. that is, the location of attention pixel i' of the 
coordinate after advancing side by side (ix* * u, iy' ■ v) is moved to the coordinate (x*- delta-y', 
y'+ delta-x " ') made finer than the pixel of frame information. 
[0072] 

Then, it judges whether coordinate transformation was performed about all the pixels of 
object frame information (S325). When S305-S325 are processed repeatedly and coordinate 
transformation is performed about all pixels, carrying out sequential migration of 
attention pixel i' when the pixel which is not performing coordinate transformation 
remains, it progresses to S330. 

In S330, it judges whether coordinate transformation was performed about all object frame 
information. This flow is ended when object frame information is set up in order of time 
series, S305-S330 are repeatedly processed, when the object frame information that 
coordinate transformation is not performed remains, and coordinate transformation is 
performed about all object frame information. 

Object frame information is convertible so that the rotation gap between the images which 
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are rotated while making an object frame image advance side by side by the above 
processing based on the amount information of advancing side by side and rotation 
information, and are expressed for reference frame information and object frame 
information may be lost. 

In addition, according to the property of a frame image etc., after multiplying u, v, and 
delta by the predetermined correction factor, coordinate transformation may be performed, 
and both frame information of both may be made to perform coordinate transformation 
using u, V, and delta which multipUed by the predetermined correction factor. 
[0073] 

(5-4) Composition of a frame image : 

After frame transform processing is completed, it progresses to S145 of drawing 11 , 
reference frame information and the object frame information that transform processing 
was performed by the above-mentioned frame transform processing are compounded with 
a synthetic means, and processing which generates the image data which carries out the 
gradation expression of the static image by many pixels is performed. 

As shown in drawing 16 , processing which piles up the object frame information by which 
coordinate transformation was carried out so that an advancing-side-by-side gap and a 
rotation gap might disappear from two or more frame information to reference frame 
information by presumption of a camera motion is performed. 
[0074] 

Drawing 17 shows synthetic processing with the flow chart. In addition, the case where the 
direction of a x axis and the direction of the yaxis increase the pixel of a frame image 1.5 
times is taken for an example, and signs that the image data expressing a static image is 
generated are explained. Carrying out sequential migration of the attention pixel which 
generates image data, this image generation equipment performs predetermined 
interpolation processing using the gradation data of the pixel which exists around an 
attention pixel among all the pixels of reference frame information and object frame 
information, and generates image data. 
[0075] 

First, the location of the attention pixel i which generates the image data which carries out 
the gradation expression of the static image is set up (S405). Although the location of the 
attention pixel i corresponding to a static image is set up like S220 of drawing 14 with this 
operation gestalt, i here differs from the attention pixel i of the reference frame 
information in the above-mentioned camera motion presumption processing. 
A setup of the attention pixel i computes the distance of the pixel and this attention pixel i 
which exist near the attention pixel i among all the pixels of all four frame information 
(S410). Next, the shortest pixel nearest to the attention pixel i is elected (S415). What is 
necessary is just to store the coordinate value of for example, the shortest pixel in the 
predetermined field in RAM in the case of election. Here, when the coordinate of the pixel 
which exists the coordinate of the attention pixel i on the basis of the image data to 
generate near UO, yO), and the attention pixel i is set to (xf, yd, {(xf-xO) 2+(yf-y0) 2} 1/2 
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should just make the pixel used as min the shortest pixel. 
[0076] 

Drawing 18 shows t3npically signs that the above-mentioned shortest pixel is chosen. In the 
example of drawing, while the location of all the pixels of reference &ame information and 
three object frame information is plotted, the location of the pixel (dense 1.5 times as many 
every direction as this) of the image data to generate is also plotted. Here, while giving 
frame number f (f= 1, 2, 3, 4) to each frame information, the pixel nearest to an attention 
pixel is elected about each of each frame information. The distance of the pixel and the 
attention pixel i which were elected is expressed with L (i, 0 among drawing. And friearest 
(i) to which L (i, t) becomes the smallest is calculated. It is in the inclination whose jaggy of 
the edge part in a static image decreases by performing interpolation processing which 
referred to the frame information containing that pixel, so that it is a pixel with this small 
value (so that the elected pixel is close to the attention pixel 0. About the attention pixel i 
of drawing, since L (i, 4) becomes the minimum value, the pixel of a frame 4 is elected. 
Then, the distance MinL from the attention pixel i to the shortest pixel (i, 0 is acquired 
(S420), and the frame information containing the shortest pixel is acquired (S425). The 
frame information on a frame 4 is acquired in the example of drawing. Here, you may 
acquire by storing the frame information containing the shortest pixel in the 
predetermined field in RAM, and may acquire by storing the memory address of the frame 
information containing the shortest pixel in the predetermined pointer in RAM. 
[0077] 

If the frame information containing the shortest pixel is acquired, predetermined 
interpolation processing of the Bayh linear etc. will be performed using the YCbCr data 
(gradation data) of the shortest pixel from this frame information, and the image data of 
the attention pixel i will be generated (S430). In that case, image data may be generated 
with YCbCr data and the image data which changes YCbCr data into the RGB data which 
consist of each RGB gradation value using a predetermined conversion type, and consists 
of RGB may be generated. 

Drawing 19 shows tjrpically signs that interpolation processing by the Bayh linear 
(primary ** interpolation method) is performed. As shown in drawing, interpolation 
processing is performed using the gradation data of four pixel 61 a-d of the circumference 
surrounding the attention pixel i including shortest pixel 61a from the acquired frame 
information. Weighting of gradation data changes gradually as another side is approached 
from one side of pixel (lattice point) 61 a-d used for a interpolation operation, and let the 
bihnear method be a linear frinction only depending on the gradation data the change of 
whose is the pixel of both sides. The field divided by four pixel 61 a-d which encloses the 
attention pixel i to interpolate here is divided into four partitions by the attention pixel i 
concerned, if weighting is carried out to the data of a diagonal location by the surface ratio, 
it is, and it is **. 

If the same thing is performed about each pixel of the generated image data, all pixel 
values can be presumed. 
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[0078] 

It can pile up based on the physical relationship between the images presumed by the 
camera motion as mentioned above, and the gradation value (pixel value) of the pixel of the 
image data to generate can be presumed from the gradation data of the pixel of the frame 
information on the neighborhood. That is, since the image data of each pixel is interpolated 
and generated, it becomes possible to obtain a high definition static image. 
Of course, in order to make the processing which generates image data accelerate, 
interpolation processing by the NIARISUTONEIBA method may be performed. In this 
case, what is necessary is just to let the gradation data of the shortest pixel of frame 
information be the image data of the attention pixel i. Moreover, accurate interpolation 
processing may be performed, for example like the Bayh cubic method. 
Furthermore, the selection input of the "Bayh cubic method", the "Bayh linear" or, and the 
"NIARISUTONEIBA method" is enabled, and you may make it the interpolation 
processing by which the selection input was carried out generate the image data of an 
attention pixel. Then, it can become possible to choose whether priority is given to image 
quality, or priority is given to processing speed, and convenience can be raised. 
[0079] 

Then, it judges whether interpolation processing generated image data about all the pixels 
that generate image data (S435). When the pixel which is not generating image data 
remains, S405-S435 are processed repeatedly, carrying out sequential migration of the 
attention pixel i on the pixel corresponding to the image data to generate. This flow is 
ended when image data is generated about all pixels. 

Thus, two or more frame information that coordinate transformation was performed is 
compounded, and the image data which carries out the gradation expression of the static 
image by many pixels is generated. In addition, you may carry out changing YCbCr data 
into RGB data using a predetermined conversion type in this phase etc. 
When actually examined, the effectiveness that a jaggy stopped going into the edge part in 
a static image was acquired by having been made to perform interpolation processing 
using the gradation data of the pixel nearest to the attention pixel i among all the pixels of 
two or more frame information. Thus, the high definition high resolution image which is 
not obtained only by using one frame can generate by using a multiple frame. Especially, 
when the precision of motion presumption of each frame image is good, it becomes possible 
to obtain a high definition high resolution image. 
[0080] 

Termination of synthetic processing displays a static image on a display based on the 
image data which progressed to S150 of drawiner 11 and was generated. 
Drawing 20 shows the dialog box 84 of the static-image preservation screen for making the 
image data which displayed and generated the static image save. In this dialog box 84, 
while displaying a static image on static-image display column 84a, permanent-file name 
input column 84b, carbon button 84c, and d are also displayed. If the actuation input of the 
file name saved in permanent-file name input column 84b is received and cUck actuation of 
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the O.K. carbon button 84c is carried out, image data will be saved by the file name 
inputted immediately at HD etc. (S155), and this flow will be ended. Thus, a user can 
acquire the scene of the request in an image as a high definition still picture. Since it is 
generated by the shortest time amount processing for acquiring image quality required at 
this time, a user's latency time does not become long vainly. 
[0081] 

Since the advancing-side;by~side gap and rotation gap between two or more firame images 
expressed for two or more firame information lose the image data expressing a static image 
and it is compounded and generated firom the firame information on this pluraUty by the 
above processing, blurring containing a rotation component is also fully amended and 
becomes possible [ obtaining a high-definition static image firom two or more fi*ame 
information on image information ]. And it becomes possible to compound a suitable 
number suitable for the image quahty of an output image of fi-ame information, and to 
generate image data. Moreover, while it becomes possible for the number of the frame 
information compounded, so that image quality setting information turns into information 
which means high definition more to increase, and to make a static image 
high'definition-ize, it becomes possible for the number of the fi-ame information 
compounded, so that image quahty setting information turns into information which 
means a high speed more to decrease, and to raise the generation rate of a static image. 
Therefore, it becomes possible to perform processing which generates the image data which 
expresses a static image efficiently, and to obtain a static image. 

The firame number to compound is determined flexibly automatically, without in other 
words a user specifying directly the number of the frame information which cannot grasp 
relation between image quahty and processing speed easily in somesthesis. The item which 
a user sets up is not a frame number but "image quahty mode" and "resolution", and is 
intuitive. Moreover, when the image size and image quahty demanded by the device are 
decided, it can arrange and can output to the image size and image quality which had the 
image source of various resolution equahzed. 

In addition, when the advancing*side'by-side gap of a predetermined center position which 
rotates an object frame image is lost, the inclination component of blurring is amended 
more certainly and it becomes possible to obtain a higher-definition static image. Moreover, 
since two or more frame information to compound is the information which followed the 
small time series of change, it becomes possible [ obtaining a static image high-definition 
with a simple configuration ] by generating the image data which such frame information 
is compounded and expresses a static image. 
[0082] 

(6) Second operation gestalt ' 

In addition, since the distance MinL to the shortest pixel (i, £) is computed in the synthetic 
processing shown by drawing 17 , a frame information number may be determined using 
this distance. 

Drawing 2 1 shows the processing which the image generation equipment concerning the 
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second operation gestalt performs with the flow chart. With this operation gestalt, 
processing of S505'S520, and S540-S550 is performed by the frame acquisition means. 
Although illustration is omitted, while receiving the actuation input which specifies an 
image file like S105-S110 of drawing 11 , after receiving the selection input of the frame 
image of a part to generate as a static image, the setting input in in every direction 
resolution and image quality mode is received, and the number W of horizontal pixels, the 
number H of vertical pixels, and an image quality mode setting value are acquired (S505). 
Next, with reference to the correspondence table shown by drawing 6 , the threshold THl 
(image quaUty setting information) corresponding to an image quality mode setting value 
is acquired (S510). This THl is a threshold about the average of the distance MinL to the 
nearest pixel (i, among the pixels of two or more frame [ pixel / in image data / each ] 
information. 
[0083] 

Then, the frame information made into reference frame information is acquired from 
image information (S515). Next, it acquires from image information by making the 
following frame information into object frame information at time series (S520). If object 
frame information is acquired, camera motion presumption processing shown by drawing 
14 will be performed, and the amounts u and v of advancing side by side and rotation delta 
to an object frame image will be acquired from a reference frame image (S525). If u, v, and 
delta are acquired, frame transform processing shown by drawing 15 will be performed, 
and coordinate transformation will be performed so that the gap with reference frame 
information may be lost about all the pixels of object frame information (S530). If frame 
transform processing is performed, while performing synthetic processing (the 1) shown by 
drawing 17 and computing MinL (i, (f about each pixel of the image data to generate, the 
image data which compounds reference frame information and object frame information, 
and carries out the gradation expression of the output image is generated (S535).. 
[0084] 

Then, the evaluation value VI for judging whether the predetermined terminating 
condition which ends acquiisition of frame information is satisfied is computed (S540). The 
evaluation value VI is the value which "^"^(ed) by pixel several W and H of the image data 
after generating total of MinL (i, £}, i.e., the average of MinL (i, 0, as expressed with the 
following formulas. 
Vl= {sigmaMinL (i, £>} /(W-H) - (36) 

And it judges whether VI is one or less (predetermined terminating condition) TH (S545). 
You may make it VI judge whether it is smallness from THl. When VI is size (or above) 
from THl, it progresses to S550 as terminating condition formation, and when VI is one or 
less TH, it progresses to S555. In S550, it judges whether predetermined 
forced-termination conditions (for example, condition that chck actuation of the 
forced-termination carbon button 83i of drawing 13 was carried out) are satisfied, and 
progresses to S555 at the time of condition formation, and at the time of condition failure, 
the following frame information is fiirther acquired from image information as object 
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frame information in order of time series, and S520-S545 are processed repeatedly, namely, 
about each pixel in the image data to generate, acquiring frame information from image 
information one by one The distance MinL from an attention pixel to a shortest maximum 
pixel (i, 0 is computed among the pixels of two or more acquired frame information. When 
it judges whether a predetermined terminating condition is satisfied based on the average 
and the threshold THl of MinL (i, t> and judges that this terminating condition is satisfied, 
acquisition of frame information will be ended. Consequently, the processing which 
acquires frame information is repeated until frame information increases and the average 
of the distance MinL to the shortest pixel (i, & becomes small to one or less threshold TH. 
And if a terminating condition is satisfied in S545, the number of the frame information 
acquired from image information will be determined, a number of frame information 
determined by synthetic processing of S535 will be compounded, and the image data 
expressing a static image will be generated. 
[00851 

Based on the generated image data, a static image is displayed S555 by the dialog box 84 
shown by drawing 20 . And image data is saved at HD etc. (S560), and this flow is ended. 
Since an output image is made to high'definition-ize more if the above processing is 
performed so that it becomes close to the pixel of the image data after the pixel of frame 
information generating, a suitable number suitable for the image quaUty of the static 
image outputted certainly of frame information can be compounded, image data can be 
generated, and it becomes possible to obtain a static image efficiently. Moreover, since a 
threshold THl becomes large and a frame information number becomes fewer so that the 
image quality of an output image is raised and an image quality mode setting value is 
made small, since a threshold THl becomes small and a frame information number 
increases so that an image quality mode setting value is enlarged, an output image can be 
obtained more quickly, and this image generation equipment is convenient. 
[0086] 

(7) Third operation gestalt • 

Drawing 22 shows the processing which the image generation equipment concerning the 
third operation gestalt performs with the flow chart, and drawing 23 shows the synthetic 
processing (the 2) performed by S635 with the flow chart. First, synthetic processing (the 
2) is explained. 

First, the threshold Lth of the shortest pixel distance is acquired (S705). For example, 
what is necessary is to display the printing interface screen which has the predetermined 
selection column, to acquire the parameter showing a threshold Lth from the actuation 
input to this selection column, and just to store in RAM. 

Here, as shown in drawing 24 , it is a threshold forjudging whether the pixel of frame 
information is in a predetermined distance from the attention pixel i in the threshold Lth 
of the shortest pixel distance. In the example of drawing, one half of the distance between 
the pixels in the image data to generate is made into the threshold Lth. It is shown that 
the circle drawn by the dotted line focusing on each pixel containing the attention pixel i is 
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in the distance of a threshold Lth from this pixel. Moreover, the number of the frame 
information which is in the distance of a threshold Lth the upper right in a circle from the 
pixel to generate is indicated. 

In addition, you may make it set up a threshold Lth automatically from values, such as the 
number of pixels of a generation image, and the total number of pixels of a frame image, 
also besides acquiring the parameter showing a threshold Lth by the actuation input. For 
example, 

Lth = 3x(distance between generation image pixels) xCnumber of generation image 
pixels)/(the frame image total number of pixels) 

Then, a threshold Lth can be set as a value with which an average of three frame image 

pixels enter in the circle shown by drawing 24 . 

[00871 

Next, the location of the attention pixel i which generates the image data which carries out. 
the gradation expression of the static image like S405-S410 of drawing 17 is set up (S710). 
Distance {(xf-xO) 2+(yf-y0) 2} 1/2 of the pixel of the coordinate (xf, yi) which exists near the 
attention pixel i among all the pixels of all frame information, and the attention pixel i of a 
coordinate (xO, yO) are computed (S715). 

Furthermore, the pixel of the frame information which the computed distance becomes 
below the threshold Lth is elected (S720). What is necessary is just to store the coordinate 
value of for example, this pixel in the predetermined field in RAM in the case of election. In 
the example of drawing 2424 , the pixel of distance L (i, 4) and the pixel of distance d, 2) 
are elected. 

Thus, a pixel [ predetermined / on the basis of the attention pixel i ] within the limits can 

be elected among two or more frame information. 

[0088] 

Then, the frame information which computes the number nf of the frame information 
which has the pixel which consists of an attention pixel i predetermined within the limits 
(i), acquires (S725), and contains the elected pixel is acquired (S730). It is set to nf(0 =2 in 
the example of drawing. Next, the YCbCr data of the shortest pixel are used from this 
frame information, predetermined interpolation processing of the interpolation processing 
by the Bayh linear etc. is performed according to frame information, and the gradation 
data according to frame information are generated (S735). That is, interpolation processing 
will be performed using the frame information which contains a pixel [ predetermined / on 
the basis of the attention pixel i ] within the limits among two or more frame information. 
And it asks for the arithmetical mean of each gradation data after interpolation processing, 
and the image data of the attention pixel i is generated (S740). Here, the gradation data 
after interpolation processing may be YCbCr data, and may be RGB data. In case 
gradation data are gathered, the geometrical mean, the harmonic mean, the average that 
attached different weight according to frame information may be performed besides the 
arithmetical mean. If the processing to average is omitted when there is only one pixel of 
the frame information which is within the limits of predetermined from the attention pixel 
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i, it wiU become possible to make the processing which generates image data accelerate. 
[0089] 

In addition, when the pixel of frame information does not exist in the distance below a 
threshold Lth (predetermined within the Umits) like the pixel iA of drawing 24 from the 
pixel of the image data to generate, interpolation processing is performed using the frame 
information on either of two or more frame information. In this case, interpolation 
processing may be performed using reference frame information, the frame information 
which contains the shortest pixel as drawing 17 showed may be acquired, and 
interpolation processing may be performed. Thus, all the pixels of the image data to 
generate can be buried certainly. 
[0090] 

Then, it judges whether interpolation processing generated image data about all the pixels 
of the image data to generate (S745). This flow is ended, when S710-S745 are processed 
repeatedly and image data is generated, about all pixels, carrying out sequential migration 
of the attention pixel i when the pixel which is not generating image data remains. 
Two or more frame information that coordinate transformation was performed is 
compounded by the above processing, and the image data which carries out the gradation 
expression of the static image by many pixels is generated. Since the gap between frame 
images cannot be highhghted and can be especially carried out when the precision of 
motion presumption of each frame image is not good, when such, it becomes possible to 
obtain a high definition high resolution image. 
[0091] 

The flow of drawing 22 is explained on the assumption that the above synthetic processing 
is performed. 

First, while receiving the actuation input which specifies an image file, after receiving the 
selection input of the frame image of a part to generate as a static image, the number W of 
horizontal pixels, the number H of vertical pixels, and an image quality mode setting value 
are acquired (S605). Next, with reference to the correspondence table shown by drawing 6 , 
the threshold TH2 (image quaUty setting information) corresponding to an image quality 
mode setting value is acquired (S610). This TH2 is a threshold about a number of frame 
information of averages which have the pixel which becomes predetermined within the 
limits about each pixel in image data. 
[0092] 

Then, the frame information made into reference frame information is acquired (S615), 
and the following frame information is acquired from image information as object frame 
information to time series (S620). If object frame information is acquired, camera motion 
presumption processing shown by drawing 14 will be performed, and the amounts u and v 
of advancing side by side and rotation delta to an object frame image will be acquired from 
a reference frame image (S625). If u, v, and delta are acquired, frame transform processing 
shown by drawing 15 will be performed, and coordinate transformation will be performed 
so that the gap with reference frame information may be lost about all the pixels of object 
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frame information (S630). If frame transform processing is performed, while performing 
synthetic processing (the 2) shown by drawing 23 and computing nf (i) about each pixel of 
the image data to generate, the image data which compounds reference frame information 
and object frame information, and carries out the gradation expression of the output image 
is generated (S635). 
[00931 

Then, the evaluation value V2 for judging whether the predetermined terminating 
condition which ends acquisition of frame information is satisfied is computed (S640). The 
evaluation value V2 is the value which **(ed) by pixel several W and H of the image data 
after generating total of nf (i), i.e., the average of nf ti), as expressed with the following 
formulas. 

V2= {sigmanf (i)} /(W-H) - (37) 

And V2 judges [ two or more (predetermined terminating condition) TH(s) or ] whether it is 
size more (S645). When V2 is smallness (or following) from TH2, it progresses to S650 as 
terminating condition formation, and when V2 is two or more TH(s), it progresses to S655. 
In S650, it judges whether predetermined forced-termination conditions are satisfied, and 
progresses to S655 at the time of condition formation, and at the time of condition failure, 
the following frame information is fiirther acquired from image information as object 
frame information in order of time series, and S620-S645 are processed repeatedly. That is, 
it asks for the number nf of the frame information which has the pixel which becomes 
predetermined within the limits about each pixel in the image data to generate while 
acquiring frame information from image information one by one (0, and judges whether a 
predetermined terminating condition is satisfied based on the average and the threshold 
TH2 of nf (i), and when it judges that this terminating condition is satisfied, acquisition of 
frame information will be ended. Consequently, the processing which acquires frame 
information is repeated until a number nf of frame information (i) of averages which frame 
information increases and have the pixel of predetermined within the limits become large 
to two or more thresholds TH. And if a terminating condition is satisfied in S645, the 
number of the frame information acquired from image information will be determined, a 
number of frame information determined by synthetic processing of S635 will be 
compounded, and the image data expressing a static image will be generated. 
[0094] 

In S655, a static image is displayed based on the generated image data. And image data is 
saved at HD etc. (S660), and this flow is ended. 

Since a static image is made to high-definition-ize more if the above processing is 
performed so that it becomes close to the pixel of the image data after the pixel of frame 
information generating, a suitable number suitable for the image quahty of the static 
image outputted certainly of frame information can be compounded, image data can be 
generated, and it becomes possible to obtain a static image efficiently. Moreover, since a 
threshold TH2 becomes small and a frame information number becomes fewer so that the 
image quality of an output image is raised and an image quality mode setting value is 
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made small, since a threshold TH2 becomes large and a frame information number 
increases so that an image quality mode setting value is enlarged, an output image can be 
obtained more quickly, and this image generation equipment is convenient. 
[0095] 

(8) Fourth operation gestalt : 

Drawing 25 shows the processing which the image generation equipment concerning the 
fourth operation gestalt performs with the flow chart, and drawing 26 shows the synthetic 
processing (the 3) performed by S835 with the flow chart. First, synthetic processing (the 
3) is explained. 

First, 0 is substituted for the counter nu formed in RAM (S905). Next, the threshold Lth of 
the shortest pixel distance is acquired Uke S505-S520 of drawing 23 . The pixel of the 
coordinate (xf, y{) which sets up the location of the attention pixel i which generates the 
image data which carries out the gradation expression of the static image, and exists near 
the attention pixel i among all the pixels of all frame information. Distance {(xf*xO) 
2+(yf-y0) 2} 1/2 with the attention pixel i of a coordinate (xO, yO) are computed, and the 
pixel of the frame information which the computed distance becomes below the threshold 
Lth is elected (S910-S925). 
[0096] 

Then, it judges whether the number of the pixels of the frame information which consists of 
an attention pixel i predetermined within the limits is 0 (S930). (is it zero or less or not?) 
One **** of Counters nu is carried out at the time of condition formation (S935), and it 
progresses to S940, and progresses to S940 as it is at the time of condition failure. In two 
[ of the image data to generate ] of 9 pixels of Pixels iA and iB, in the example of drawing 
24 , the pixel does not exist in predetermined within the limits. Therefore, when attention 
pixels are Pixels iA and iB^ nu increases every [ 1 ]. 

In S940-S950, the frame information which contains the elected pixel like the above 
S730-S740 is acquired, the YCbCr data of the shortest pixel are iised from this frame 
information, predetermined interpolation iprocessing of the interpolation processing by the 
Bayh hnear etc. is performed according to frame information, the gradation data according 
to frame information are generated, it asks for the arithmetical mean of each gradation 
data after interpolation processing, and the image data of the attention pixel i is generated. 
And it judges whether interpolation processing generated image data about aU the pixels 
of the image data to generate (S955). This flow is ended, when S915-S955 are processed 
repeatedly and image data is generated about all pixels, carrying out sequential migration 
of the attention pixel i when the pixel which is not generating image data remains. 
[0097] 

The flow of drawing 25 is explained on the assumption that the above synthetic processing 
is performed. 

First, while receiving the actuation input which specifies an image file, after receiving the 
selection input of the frame image of a part to generate as a static image, the number W of 
horizontal pixels, the number H of vertical pixels, and an image quality mode setting value 
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III 



are acquired (S805). Next, with reference to the correspondence table shown by drawing 6 , 
the threshold TH3 (image quality setting information) corresponding to an image quaUty 
mode setting value is acquired (S810). This TH3 is a threshold about a number of a pixel of 
ratios with which the number of the pixels of the &ame information which becomes 
predetermined within the limits among the pixels concerned to the total of the pixel of 
image data is set to 0. 
[0098] 

Then, the frame information made into reference frame information is acquired (S815), 
and the following frame information is acquired from image information as object frame 
information to time series (S820). If object frame information is acquired, camera motion 
presumption processing shown by drawing 14 will be performed, and the amounts u and v 
of advancing side by side and rotation delta to an object frame image will be acquired from 
a reference frame image (S825). If u, v, and delta are acquired, frame transform processing 
shown by drawing 15 will be performed, and coordinate transformation will be performed 
so that the gap with reference frame information may be lost about all the pixels of object 
frame information (S830). If frame transform processing is performed, while performing 
synthetic processing (the 3) shown by drawing 23 and calculating nu, the image data which 
compounds reference frame information and object frame information, and carries, out the 
gradation expression of the output image is generated (S835). 
[0099] 

Then, the evaluation value V3 for judging whether the predetermined terminating 
condition which ends acquisition of frame information is satisfied is computed (S840). The 
evaluation value V3 is the value which **(ed) by pixel several W and H of the image data 
after generating nu, i.e., the rate which is the pixel to which a pixel does not exist in 
predetermined within the limits among all the pixels to generate, as expressed with the 
following formulas. 
V3=nu/(W"H) " (38) 

And V3 judges [ three or less (predetermined terminating condition) TH or ] whether it is 
smallness more (S845). When V3 is size (or above) from TH3, it progresses to S850 as 
terminating condition formation, and when V3 is three or less TH, it progresses to S855. In 
S850, it judges whether predetermined forced-termination conditions are satisfied, and 
progresses to S855 at the time of condition formation, and at the time of condition failure, 
the following frame information is further acquired from image information as object 
frame information in order of time series, and S820-S845 are processed repeatedly. That is, 
it asks for the number nu of pixels with which the number of the pixels of the frame 
information which becomes predetermined within the limits among the pixels in the image 
data to generate while acquiring frame information from image information one by one is 
set to 0, and judges whether a predetermined terminating condition is satisfied based on 
nu and a threshold TH3, and when it judges that this terminating condition is satisfied, 
acquisition of frame information will bie ended. Consequently, the processing which 
acquires frame information is repeated until the ratio of the number nu which is the pixel 
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to which a pixel does not exist in predetermined within the limits among the pixels of the 
image data which frame information increases and generates becomes small to three or 
less threshold TH. And if a terminating condition is satisfied in S845, the number of the 
frame information acquired from image information will be determined, a number of frame 
information determined by synthetic processing of S835 will be compounded, and the 
image data expressing a static image will be generated. 
[0100] 

In the example of drawing 24 , since two of 9 pixels of the image data to generate are zero 
pixel of predetermined within the Umits, 2/9= 0.22 becomes the evaluation value V3. 
Supposing an image quaUty mode setting value is 3 in the example of drawing 6 , a 
threshold TH3 will be 0.2 and will condition fall through by S845. Then, object frame 
information will be added one by S820'S840, and frame transform processing will be 
performed. When object frame information (frame 5) was added one from the condition of 
drawing 24 that a frame information number is 4 and frame transform processing was 
performed, it should change into the condition which shows in drawing 27 . Since 1 pixel of 
pixels of Pixel iA does not exist in predetermined within the limits among 9 pixels of the 
image data to generate at this time, the evaluation value V3 is set to 1 / 9= 0.11. Then, 
since it is set to V3 <=TH3, the criteria of a terminating condition are attained and it 
becomes condition formation by S845. 
[0101] 

In S855, a static image is displayed based on the generated image data. And image data is 
saved at HD etc. (S860), and this flow is ended. 

Since a static image is made to high-definition-ize more if the above processing is 
performed so that it becomes close to the pixel of the image data after the pixel of frame 
information generating, a suitable number suitable for the image quahty of the static 
image outputted certainly of frame information can be compounded, image data can be 
generated, and it becomes possible to obtain a static image efficiently. 
In addition, it is possible not to attain criteria for the reason of the image of the same 
contents continuing, at all, however it may add frame information. What is necessary is 
just to estabUsh a means to stop so that it may not become an endless loop, even when 
criteria are not attained to the loop formation which adds frame information the sake [ at 
that time 1. For example, an endless loop is avoidable ending, if the upper limit of the only 
compounded frame information number is prepared, or count continuation of a convention 
is carried out and an evaluation value hardly changes etc. 
[0102] 

By the way, in S930 of drawing 26 , it judges whether the number of the pixels of the frame 
information which consists of an attention pixel i predetermined within the hmits is below 
a predetermined number (for example, l), and when it is below a predetermined number, it 
may be made to carry out 1 **** of nu(s). Since the ratio of nu to the total number of pixels 
of the image data to generate serves as an index showing how near the pixel of frame 
information is from the pixel of the image data after generation even if it is this case, a 
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static image is made more into high definition, so that a threshold TH3 becomes small (so 
that an image quality mode setting value becomes large), image data can be generated 
more at high speed, so that a threshold TH3 becomes. large, and this image generation 
equipment is convenient. 

Although the example which took in some image quality setting information in drawing 6 
has so far been explained, the approach using image quality setting information (the l) is a 
simple method of determining a firame number before firame acquisition. A processing 
burden is placed, in order for the approach using image quality setting information (the 
2"4) compared with it to acquire information by the approach defined about each pixel in 
image data, respectively and to summarize the information on all pixels. If there are many 
firame numbers to compound and the amount of gaps of each fi'ame information is random, 
the almost same result will be obtained by adjusting each approach to the suitable set 
point or a suitable threshold. However, when a bias is in the amount of gaps of each firame 
information, not reaching desired image quality partially by the approach using image 
quality setting information (the l) also has an approach more effective [ it is composition of 
about four fi*ames, and ] for a certain reason using image quahty setting information (the 
2-4). If the image quality setting information that it united with the approach of a 
synthetic means is used as it is in the example explained so far, it is possible to mitigate a 
processing burden. 
[0103] 

(9) Conclusion : 

Various configurations are possible for the image generation equipment of this invention. 
For example, a printer may be united with a computer. About the flow mentioned above, it 
may be made to perform a part or all with a printer or the image output unit of dedication 
also besides performing within the body of a computer. 

The pixel of a large number which constitute image data can consider various 
configurations also besides considering as the shape of a dot matrix tidily located in a line 
in aU directions. For example, image data may consist of pixels tidily located in a line in 
the shape of [ of a bee which put the forward hexagon in order densely ] a blow hole. 
This invention is applicable also to generating the image data which compounds some 
firame images and expresses a static image. Moreover, minuteness can be raised, when 
demonstrating effectiveness also to I-P conversion and displaying and printing one scene of 
a dynamic image as a still picture of high resolution by piling up for every field, even if it is 
an interlace image with the field which is not known for every line. Of course, it is not 
necessarily effective also in the superposition (for example, panorama composition etc.) of 
the multiple firame aiming at resolution conversion. 
[0104] 

Furthermore, in case the amount of advancing side by side and rotation of a firame image 
are detected, you may detect, changing reference firame information. Since it is common for 
there to be few gaps between the images expressed for the second and third firame 
information which adjoined in order of time series than the rotation gap between the 
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images expressed for the first and third frame information when acquiring the second and 
third frame information for a start in order of time series, the rotation showing the amount 
of advancing side by side which expresses an advancing-side-byside gap with high degree 
of accuracy more, or a rotation gap is detectable. Therefore, the amount information of 
advancing side by side and rotation information can be acquired with high degree of 
accuracy, and it becomes possible to obtain a higher- definition static image. 
As explained above, according to this invention, the image generation equipment which 
processing which generates the image data expressing a static image is performed 
efficiently, and can obtain a static image efficiently by various modes, and an image 
generator can be offered. Moreover, it is applicable also as an image generation method. 
[Brief Description of the Drawings] 

[Drawing l] Drawing showing the outline configuration of a printing system. 
[Drawing 2] The block diagram showing the configuration of a printer. 
[Drawing 3l Drawing showing the outline of the configuration of image generation 
equipment typically. 

[Drawing 4l Drawing showing the configuration of frame information typically. 
[Drawing 5l Drawing showing typically signs that the amount of advancing side by side 
and a rotation are detected. 

[Drawing 6] Drawing showing the example of image quality setting information. 
[Drawing 7] Drawing showing tj^ically signs that a reference frame image and an object 
frame image are piled up. 

[Drawing 8l Drawing showing t5rpically signs that the amount of advancing side by side is 
presumed with a gradient method. 

[Drawing 9] Drawing showing the rotation of a pixel typically. 

[Drawing 10] Drawing showing typically signs that the amount of advancing side by side is 
presumed by the pattern matching method. 

[Drawing ll] The flow chart which shows the processing which image generation 
equipment performs. 

[Drawing 12l Drawing showing the example of a display of a frame image selection screen. 
[Drawing 13] Drawing showing the example of a display of a scene acquisition setting 
screen. 

[Drawing 14] The flow chart which shows camera motion presumption processing. 
[Drawing 15] The flow chart which shows frame transform processing. 
[Drawing 16] Drawing showing typically signs that carry out coordinate transformation of 
the object frame information, and it is piled up. 

[Drawing 17] The flow chart which shows synthetic processing (the 1). 
[Drawing 18] Drawing showing t5rpically signs that the shortest pixel is chosen. 
[Drawing 19] Drawing showing typically signs that interpolation processing by the Bayh 
Unear is performed. 

[Drawing 20] Drawing showing the example of a display of a static-image preservation 
screen. 
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[Drawing 2ll The flow chart which shows the processing which the image generation 
equipment concerning the second operation gestalt performs. 

[Drawing 22] The flow chart which shows the processing which the image generation 

equipment concerning the third operation gestalt performs. 

[Drawing 23] The flow chart which shows synthetic processing (the 2). 

[Drawing 24] Drawing showing tj^ically signs that the pixel of predetermined within the 

limits is chosen {rom the attention pixel i. 

[Drawing 25] The flow chart which shows the processing which the image generation 

equipment concerning the fourth operation gestalt performs. 

[Drawing 26] The flow chart which shows synthetic processing (the 3). 

[Drawing 27] Drawing showing typically the condition of having added frame information 

one from the condition of drawing 24 . 

[Description of Notations] 

10 A personal computer (PC), 11 - CPU, 12 - ROIM, 13 - RAM, 14 " A hard dislc (HD), 
15 DVD-ROIVI drive, I/O for a- 17 1394, 17 b e - Various interfaces O/F), 18a [ - Inlc jet 
printer, ] A display, 18b A keyboard, 18c - A mouse, 20 30 A digital camcorder, 51 - 
A pixel, 52 a-d Frame information, 52cl -- A core, 53a, C" object, 61a - The shortest pixel, 
61 b-d " Pixel, 100 [ - Two or more frame information, ] " A printing system, Dl - Image 
information, D2 " Frame information, D3 D31 " Reference frame information, D32 " 
Object frame information, D4 -* Rotation information, D5 [ Gradation data, DlO / - 
Image quality setting information, UO / " Image generation equipment, Ul / " A frame 
acquisition means, U2 / ** The amount acquisition means of gaps U3 / - A conversion 
means, U4 / Synthetic means ] - The amount information of advancing side by side, D6 " 
Frame information, D7 Image data, D8 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Di^awing l] Drawing showing the outhne configuration of a printing system. 
[Drawing 2] The blocls: diagram showing the configuration of a printer. 
[Drawing 3] Drawing showing the outUne of the configuration of image generation 
equipment typically. 

[Drawing 4] Drawing showing the configuration of frame information typically. 
[Drawing 5] Drawing showing typically signs that the amount of advancing side by side 
and a rotation are detected. 

[Drawing 6] Drawing showing the example of image quality setting information. 
[Drawing 7] Drawing showing typically signs that a reference frame image and an object 
frame image are piled up. 

[Drawing 8] Drawing showing t3rpically signs that the amount of advancing side by side is 
presumed with a gradient method. 
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[Drawing 9] Drawing showing the rotation of a pixel tjrpically. 

[Drawing lOl Drawing showing typically signs that the amount of advancing side by side is 
presumed by the pattern matching method. 

[Drawing 111 The flow chart which shows the processing which image generation 
equipment performs. 

rawing 12] Drawing showing the example of a display of a frame image selection screen. 
[Drawing 13] Drawing showing the example of a display of a scene acquisition setting 
screen. 

[Drawing 14l The flow chart which shows camera motion presumption processing. 
[Drawing 15] The flow chart which shows frame transform processing. 
[Drawing 16] Drawing showing typically signs that carry out coordinate transformation of 
the object frame information, and it is piled up. 

[Drawing 17] The flow chart which shows synthetic processing (the l). 
[Drawing 18] Drawing showing typically signs that the shortest pixel is chosen. 
[Drawing 19] Drawing showing typically signs that interpolation processing by the Bayh 
linear is performed. 

[Drawing 20] Drawing showing the example of a display of a static-image preservation 
screen. 

[Drawing 2 1] The flow chart which shows the processing which the image generation 
equipment concerning the second operation gestalt performs. 

[Drawing 22] The flow chart which shows the processing which the image generation 

equipment concerning the third operation gestalt performs. 

[Drawing 23] The flow chart which shows synthetic processing (the 2). 

[Drawing 24] Drawing showing typically signs that the pixel of predetermined within the 

limits is chosen from the attention pixel i. 

[Drawing 25] The flow chart which shows the processing which the image generation 
equipment concerning the fourth operation gestalt performs. 
[Drawing 26] The flow chart which shows synthetic processing (the 3). 

rawing 27] Drawing showing typically the condition of having added frame information 
one from the condition of drawing 24 . 
[Description of Notations] 

10 - A personal computer (PC), 11 - CPU, 12 - ROM. 13 " RAM, 14 - A hard disk (HD), 
15 - DVD-ROM drive, I/O for a--17 1394, 17 be " Various interfaces O/F), 18a [ - Inkjet 
printer, ] - A display, 18b - A keyboard, 18c - A mouse, 20 30 - A digital camcorder, 51 - 
A pixel, 52 a-d - Frame information, 52c 1 - A core, 53a, c- object, 61a - The shortest pixel, 
61 b-d ■- Pixel, 100 [ " Two or more frame information, ] - A printing system, Dl - Image 
information, D2 - Frame information, D3 D31 - Reference frame information, D32 " 
Object frame information, D4 - Rotation information, D5 [ Gradation data, DIO / - 
Image quahty setting information, UO / - Image generation equipment, Ul / - A frame 
acquisition means, U2 / -* The amount acquisition means of gaps U3 I — A conversion 
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means, U4 / Synthetic means 1 The amount information of advancing side by side, D6 * 
Frame information, D7 Image data, D8 
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